-- Logs begin at Thu 2022-07-21 09:54:31 UTC, end at Thu 2022-07-21 11:07:59 UTC. -- Jul 21 10:36:56.020325 dv-cinder-849800-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 21 10:36:56.029973 dv-cinder-849800-2-iscsi devstack@n-api.service[110328]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 21 10:36:56.032145 dv-cinder-849800-2-iscsi devstack@n-api.service[110328]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 21 10:36:56 2022] *** Jul 21 10:36:56.032145 dv-cinder-849800-2-iscsi devstack@n-api.service[110328]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 21 10:36:56.032145 dv-cinder-849800-2-iscsi devstack@n-api.service[110328]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 21 10:36:56.032145 dv-cinder-849800-2-iscsi devstack@n-api.service[110328]: nodename: dv-cinder-849800-2-iscsi Jul 21 10:36:56.032145 dv-cinder-849800-2-iscsi devstack@n-api.service[110328]: machine: x86_64 Jul 21 10:36:56.032145 dv-cinder-849800-2-iscsi devstack@n-api.service[110328]: clock source: unix Jul 21 10:36:56.032145 dv-cinder-849800-2-iscsi devstack@n-api.service[110328]: pcre jit disabled Jul 21 10:36:56.032145 dv-cinder-849800-2-iscsi devstack@n-api.service[110328]: detected number of CPU cores: 4 Jul 21 10:36:56.032145 dv-cinder-849800-2-iscsi devstack@n-api.service[110328]: current working directory: / Jul 21 10:36:56.032145 dv-cinder-849800-2-iscsi devstack@n-api.service[110328]: detected binary path: /usr/bin/uwsgi-core Jul 21 10:36:56.033018 dv-cinder-849800-2-iscsi devstack@n-api.service[110328]: your processes number limit is 47680 Jul 21 10:36:56.033018 dv-cinder-849800-2-iscsi devstack@n-api.service[110328]: your memory page size is 4096 bytes Jul 21 10:36:56.033018 dv-cinder-849800-2-iscsi devstack@n-api.service[110328]: detected max file descriptor number: 2048 Jul 21 10:36:56.033018 dv-cinder-849800-2-iscsi devstack@n-api.service[110328]: lock engine: pthread robust mutexes Jul 21 10:36:56.033018 dv-cinder-849800-2-iscsi devstack@n-api.service[110328]: thunder lock: enabled Jul 21 10:36:56.033018 dv-cinder-849800-2-iscsi devstack@n-api.service[110328]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 21 10:36:56.033018 dv-cinder-849800-2-iscsi devstack@n-api.service[110328]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 21 10:36:56.076988 dv-cinder-849800-2-iscsi devstack@n-api.service[110328]: Python main interpreter initialized at 0x55e6af0399c0 Jul 21 10:36:56.076988 dv-cinder-849800-2-iscsi devstack@n-api.service[110328]: python threads support enabled Jul 21 10:36:56.076988 dv-cinder-849800-2-iscsi devstack@n-api.service[110328]: your server socket listen backlog is limited to 100 connections Jul 21 10:36:56.076988 dv-cinder-849800-2-iscsi devstack@n-api.service[110328]: your mercy for graceful operations on workers is 90 seconds Jul 21 10:36:56.077384 dv-cinder-849800-2-iscsi devstack@n-api.service[110328]: mapped 403077 bytes (393 KB) for 2 cores Jul 21 10:36:56.077461 dv-cinder-849800-2-iscsi devstack@n-api.service[110328]: *** Operational MODE: preforking *** Jul 21 10:36:56.077711 dv-cinder-849800-2-iscsi devstack@n-api.service[110328]: *** uWSGI is running in multiple interpreter mode *** Jul 21 10:36:56.077711 dv-cinder-849800-2-iscsi devstack@n-api.service[110328]: spawned uWSGI master process (pid: 110328) Jul 21 10:36:56.077930 dv-cinder-849800-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 21 10:36:56.078941 dv-cinder-849800-2-iscsi devstack@n-api.service[110328]: spawned uWSGI worker 1 (pid: 110329, cores: 1) Jul 21 10:36:56.078941 dv-cinder-849800-2-iscsi devstack@n-api.service[110328]: spawned uWSGI worker 2 (pid: 110330, cores: 1) Jul 21 10:36:56.080731 dv-cinder-849800-2-iscsi devstack@n-api.service[110328]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 21 10:36:56.753394 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 21 10:36:56.768223 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 21 10:36:57.895702 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 10:36:57.895702 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: from cryptography.utils import int_from_bytes Jul 21 10:36:57.896316 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 10:36:57.896316 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: from cryptography.utils import int_from_bytes Jul 21 10:36:57.910816 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 10:36:57.910816 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: from cryptography.utils import int_from_bytes Jul 21 10:36:57.911350 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 10:36:57.911350 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: from cryptography.utils import int_from_bytes Jul 21 10:37:00.419040 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 21 10:37:00.419673 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 21 10:37:00.420047 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 21 10:37:00.420133 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 21 10:37:00.420214 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 21 10:37:00.420309 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 21 10:37:00.420391 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 21 10:37:00.420482 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 21 10:37:00.420568 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 21 10:37:00.420649 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 21 10:37:00.420751 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.420841 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.420967 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.421057 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.421281 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.421368 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.421592 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.421681 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.421918 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.422005 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.422221 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.422329 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.422536 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.422646 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.422936 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.423208 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.428188 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.428325 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.428447 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.428537 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.428605 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.428740 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.428839 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849800-2-iscsi {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.428964 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849800-2-iscsi {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.429065 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.429148 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.429226 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.429355 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.429453 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.429542 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.429623 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.429702 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.429835 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.429930 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.430012 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.430091 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.430225 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.430320 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.430402 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.430607 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.430752 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.430838 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.430964 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.431048 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.431136 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.431217 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.431352 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.431453 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.431542 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.431673 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.431777 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.431914 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.432000 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.432087 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.432167 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.432293 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.432386 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.432468 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.432546 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.432681 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.432806 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849800-2-iscsi {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.432939 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849800-2-iscsi {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.433066 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.433204 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.433296 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.433377 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.433455 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.433533 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.433612 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.433710 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.433799 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.433928 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.434017 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.434107 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.434188 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.434276 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.434365 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.434486 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.434605 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.434703 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.434793 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.434874 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.434952 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.435037 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.435124 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.435212 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.435299 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.435389 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.435476 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.435564 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.435649 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.435730 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.435815 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.435900 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.435980 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.436058 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.436145 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.436242 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.436323 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.436417 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.436509 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.436590 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.436834 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.436922 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.437002 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.437091 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.437179 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.437267 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.437445 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.437538 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.437703 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.437829 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.438012 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.438174 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.438318 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.439005 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.439135 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.439269 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.439472 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.439614 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.439758 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.439895 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.440040 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.440177 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.440343 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.440483 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.440802 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.440921 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.441132 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.441248 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.441342 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.441430 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.441524 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.441649 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.442056 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.442231 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.442318 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.442432 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.442667 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.442843 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.442958 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.443211 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.443327 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.443491 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.443593 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.443812 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.443965 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.444150 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.444365 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.444501 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.444586 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.444766 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.444948 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.445090 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.445193 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.445316 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.445482 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.445634 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.445828 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.445989 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.446181 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.446286 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.446437 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.446579 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.446811 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.446961 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.447171 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.447279 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.447475 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.447580 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.447726 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.447961 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.448130 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.448234 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.448325 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.448497 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.448643 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.448825 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.448945 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.449130 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.449276 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.449477 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.449566 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.449774 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.449904 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.450075 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.450162 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.450375 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.450462 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.450702 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.450792 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.451007 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.451093 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.451309 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.451419 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.451607 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.451728 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.451914 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.452081 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.452296 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.452428 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.452616 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.452764 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.452901 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.453117 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.453327 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.453514 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.453676 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.453824 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.453976 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.454875 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.455083 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.455244 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.455244 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.455518 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.455875 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.456097 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.456263 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.456484 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.456626 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.456750 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.456843 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.456967 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.457167 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.457267 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.457349 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.457429 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.457508 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.457597 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.457679 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.457908 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.458042 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.458199 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.458288 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.458501 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.458612 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.458842 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.458949 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.459155 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.459330 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.459475 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.459612 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.459764 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.459886 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.460061 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.460185 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.460361 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.460484 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.460666 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.460753 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.460971 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.461103 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.461269 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.461354 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.461572 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.461674 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.461872 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.462006 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.462171 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.462315 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.462467 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.462629 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.462791 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.462920 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.463091 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.463208 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.463406 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.463504 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.463711 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.463821 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.464028 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.464146 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.464334 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.464443 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.464644 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.464746 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.465003 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.465114 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.465329 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.465427 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:37:00.465647 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.465737 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.465961 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.466047 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.466275 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.466372 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.466623 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.466716 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.466942 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.467038 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.467255 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.467370 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.467565 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.467652 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.467873 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.467959 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.468186 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.468287 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.468512 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.468598 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.468825 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.468912 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.469135 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.469246 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.469445 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.469541 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.469776 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.469864 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.470091 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.470197 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.470417 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.470502 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.470757 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.470846 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.471066 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.471164 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.471379 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.471465 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.471686 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.471772 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.472000 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.472096 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.472327 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.472423 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.472643 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.472736 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.472951 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.473048 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.473257 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.473350 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.473566 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.473649 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.473886 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.473983 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.474213 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.474301 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.474522 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.474653 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.474862 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.474953 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.475174 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.475267 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.475485 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.475571 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.475795 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.475882 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.476107 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.476194 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.476417 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.476503 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.476729 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.476816 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.477039 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.477126 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.477349 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.477463 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.477655 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.477742 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.477959 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.478045 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.478265 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.478361 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.478587 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.478677 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.478899 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.479002 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.479204 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.479303 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.479509 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.479611 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.479811 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.479899 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.480115 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.480215 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.480415 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.480500 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.480718 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.480859 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.481019 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.481116 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.481320 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.481408 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.481623 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.481709 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.481931 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.482018 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.482233 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.482319 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.482567 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.482656 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.482869 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.482965 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.483176 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.483262 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.483487 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.483574 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.483798 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.483897 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.484102 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.484188 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.484406 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.484491 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.484712 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.484800 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.485012 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.485096 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.486100 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.486209 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.486409 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.486496 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.486752 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.486849 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.487069 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.487170 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.487385 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.487517 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.487696 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.487797 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.488009 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.488125 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.488311 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.488409 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.488616 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.488714 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.488929 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.489036 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.489237 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.489335 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.489568 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.489666 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.489896 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.490002 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.490203 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.490300 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.490527 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.490651 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.490857 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.490948 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.491166 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.491254 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.491470 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.491556 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.491782 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.491872 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.492087 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.492183 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.492392 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.492488 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.492698 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.492799 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.493006 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.493094 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.493307 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.493402 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.493611 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.493697 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.493914 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.494071 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.494216 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.494363 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.494520 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.494631 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.494827 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.494914 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.495129 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.495233 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.495430 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.495518 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.495729 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.495816 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.496029 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.496168 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.496328 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.496415 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.496648 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.496734 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.496954 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.497044 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.497255 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.497341 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.497557 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.497657 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.497853 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.497942 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.498194 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.498285 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.498496 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.498614 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.498855 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.498951 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.499170 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.499265 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.499480 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.499580 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.499794 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.499900 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.500097 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.500191 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.500407 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.500502 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.500713 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.500809 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.501575 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.501690 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.501899 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.502120 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.502208 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.502435 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.502522 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.502779 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.502867 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.503090 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.503186 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.503408 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.503501 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.503717 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.503803 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.504040 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.504128 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.504354 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.504448 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.504669 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.504835 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.504972 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.505068 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.505285 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.505371 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.505596 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.505693 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.505905 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.505992 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.506214 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.506300 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.506531 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.506657 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.506858 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.506954 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.507169 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.507256 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.507476 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.507589 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.507781 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.507870 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.508087 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.508172 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.508393 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.508489 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.508696 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.508785 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.508998 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.509085 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.509309 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.509397 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.509616 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.509704 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.509938 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.510036 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.510239 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.510326 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.510581 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.510674 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.510873 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.510973 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.511180 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.511274 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.511491 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.511577 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.511796 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.511883 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.512102 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.512189 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.512404 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.512488 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.512715 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.512809 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.513019 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.513105 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.513325 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.513422 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.513626 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.513720 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.513924 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.514011 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.514233 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.514328 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.514534 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.514653 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.514859 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.514960 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.515163 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.515248 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.515470 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.515565 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.515772 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.515858 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.516081 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.516167 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.516384 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.516471 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.516718 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.516835 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.517106 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.517197 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.517413 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.517504 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.517735 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.517851 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.518043 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.518130 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.518362 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.518450 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.518700 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.518790 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.519002 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.519087 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.519304 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.519393 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.519621 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.519707 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.519932 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.520041 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.520242 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.520341 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.520548 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.520643 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.520863 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.520960 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.521185 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.521286 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.521484 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.521581 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.521805 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.521903 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.522114 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.522201 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.522420 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.522515 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.522749 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.522847 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.523058 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.523153 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.523365 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.523452 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.523668 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.523764 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.523984 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.524073 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.524292 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.524380 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.524596 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.524684 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.524901 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.524994 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.525204 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.525289 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.525509 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.525598 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.525812 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.525909 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.526130 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.526384 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.526480 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.526740 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.526843 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.527046 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.527142 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.527344 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.527457 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.527648 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.527744 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.527961 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.528063 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.528291 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.528519 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.528612 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.528846 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.528946 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.529157 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.529255 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.529473 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.529564 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.529787 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.529893 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.530101 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.530188 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.530412 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.530506 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.530757 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.530847 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.531066 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.531153 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.531372 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.531475 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.531677 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.531764 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.531981 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.532069 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.532426 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.532606 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.532760 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.533055 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.533156 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.533355 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.533450 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.533658 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.533748 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.533964 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.534064 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.534270 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.534397 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.534590 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.534683 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.534894 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.534981 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.535194 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.535301 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.535503 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.535598 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.535803 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.535893 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.536106 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.536201 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.536451 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.536548 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.536759 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.536856 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.537091 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.537194 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.537392 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.537480 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.537692 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.537780 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.537997 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.538117 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.538333 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.538435 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.538672 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.538789 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.538987 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.539094 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.539294 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.539399 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.539601 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.539697 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.539956 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.540060 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.540258 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.540355 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.540562 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.540656 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.540864 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.541012 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.541161 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.541297 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.541447 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.541591 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.541727 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.541861 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.542029 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.542168 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.542329 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.542469 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.542657 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.542747 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.542959 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.543044 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.543267 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.543365 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.543614 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.543709 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.543912 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.544000 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.544222 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.544317 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.544522 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.544634 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.544821 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.544907 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.545121 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.545208 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.545421 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.545506 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.545718 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.545802 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.546025 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.546120 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.546328 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.546414 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.546655 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.546760 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.546962 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.547051 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.547258 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.547358 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.547559 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.547644 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.548421 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.548520 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.548757 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.548938 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.549166 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.549266 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.549478 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.549567 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.549785 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.549873 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.550086 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.550180 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.550405 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.550494 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.550735 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.550838 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.551037 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.551137 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.551337 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.551428 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.551649 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.551735 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.551961 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.552056 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.552265 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.552352 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.552570 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.552663 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.552876 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.552963 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.553182 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.553267 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.553482 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.553568 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.553779 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.553866 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.554075 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.554161 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.554374 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.554470 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.554748 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.554841 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.554995 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.555082 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.555292 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.555386 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.555591 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.555679 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.555887 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.555974 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.556186 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.556282 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.556483 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.556572 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.556800 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.556889 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.557102 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.557199 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.557400 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.557486 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.557699 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.557786 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.557997 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.558163 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.558334 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.558430 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.558656 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.558760 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.558967 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.559102 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.559277 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.559364 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.559591 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.559679 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.559899 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.559996 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.560203 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.560289 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.560508 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.560606 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.560808 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.560896 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.561103 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.561189 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.561411 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.561504 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.561713 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.561801 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.562021 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.562109 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.562319 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.562405 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.562647 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.562739 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.562966 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.563052 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.563270 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.563356 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.564467 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.564576 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.564659 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.564755 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.564847 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.564937 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.565018 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.565104 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.565306 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.565414 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.565616 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.565716 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.565927 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.566020 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.566238 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.566332 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.566550 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.566652 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.566868 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.566956 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.567177 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.567262 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.567487 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.567582 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.567793 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.567887 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.568119 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.568206 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.568423 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.568517 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.568728 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.568816 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.569030 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.569115 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.569335 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.569427 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.569638 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.569740 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.569941 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.570034 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.570253 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.570379 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.570563 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.570716 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.570882 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.571027 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.571183 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.571332 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.571485 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.571643 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.571787 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.571955 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.572213 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.572310 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.572519 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.572608 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.572824 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.572920 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.573123 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.573264 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.573428 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.573571 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.573733 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.573883 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.574040 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.574192 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.574349 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.574498 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.574670 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.574827 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.575091 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.575178 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.575398 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.575484 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.575706 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.575796 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.576012 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.576101 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.576314 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.576400 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.576614 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.576711 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.576919 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.577007 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.577238 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.577324 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.577539 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.577658 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.577839 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.577970 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.578138 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.578276 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.578457 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.578722 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.578880 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.579218 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.579423 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.579700 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.579849 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.579986 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.580139 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.580276 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.580411 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.580556 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.580774 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.580930 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.581061 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.581197 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.581332 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.581477 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.581612 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.581772 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.581920 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.582074 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.582217 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.582353 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.582489 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.582652 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.582734 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.582802 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.582966 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.583082 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.583290 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.583390 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.583616 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.583717 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.583921 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.584018 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.584231 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.584381 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.584534 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.584711 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.584859 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.585022 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.585176 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.585342 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.585482 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.585668 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.585799 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.585975 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.586208 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.586307 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.586526 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.586638 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.586853 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.586943 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.587170 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.587260 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.587489 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.587583 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.587790 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.587886 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.588090 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.588178 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.588394 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.588482 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.588690 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.588802 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.588992 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.589090 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.589298 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.589387 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.589597 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.589692 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.589900 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.589988 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.590203 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.590300 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.590506 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.590651 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.590829 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.590918 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.591126 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.591215 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.591442 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.591533 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.591741 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.591836 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.592056 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.592142 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.592359 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.592450 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.592662 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.592771 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.592966 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.593067 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.593267 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.593357 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.593585 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.593688 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.593893 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.593993 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.594189 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.594287 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.594489 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.594597 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.594895 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.594983 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.595165 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.595263 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.595554 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.595702 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.595872 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.595973 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.596189 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.596277 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.596512 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.596600 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.596815 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.596910 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.597119 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.597207 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.597430 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.597518 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.597735 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.597869 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.598041 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.598128 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.598347 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.598449 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.598667 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.598760 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.598970 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.599057 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.599275 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.599374 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.599574 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.599676 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.599873 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.599961 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.600174 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.600260 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.600476 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.600608 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.600774 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.600864 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.601070 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.601161 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.601368 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.601458 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.601667 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.601760 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.601970 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.602071 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.602286 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.602373 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.602607 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.602756 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.602909 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.603026 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.603213 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.603314 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.603507 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.603594 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.603843 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.603959 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.604145 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.604245 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.604470 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.604559 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.604780 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.604948 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.605095 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.605183 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.605407 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.605492 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.605710 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.605798 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.606024 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.606112 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.606334 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.606421 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.606664 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.606754 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.606975 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.607072 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.607286 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.607373 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.607594 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.607681 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.607904 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.608117 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.608207 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.608446 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.608549 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.608761 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.608848 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.609076 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.609165 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.609389 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.609478 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.609703 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.609899 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.610063 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.611004 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.611197 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.611359 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.611561 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.611707 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.611883 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.612017 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.612200 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.612326 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.612531 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.612626 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.612856 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.613018 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.613184 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.613335 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.613515 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.613611 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.613820 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.613917 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.614134 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.614285 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.614450 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.614589 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.614790 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.614893 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.615124 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.615211 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.615435 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.615538 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.615744 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.615871 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.616054 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.616142 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.616362 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.616450 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.616674 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.616762 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.616985 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.617073 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.617295 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.617392 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.617603 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.617692 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.617913 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.618001 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.618220 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.618319 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.618525 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.618639 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.618850 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.618939 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.619159 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.619260 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.619467 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.619554 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.619773 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.619861 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.620077 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.620166 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.620383 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.620470 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.620690 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.620778 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.621070 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.621174 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.621336 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.621524 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.621651 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.621841 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.621943 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.622173 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.622262 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.622499 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.622618 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.622848 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.623070 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.623158 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.623386 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.623473 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.623720 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.623822 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.624044 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.624132 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.624358 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.624453 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.624669 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.624766 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.624978 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.625079 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.625284 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.625374 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.625597 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.625693 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.626070 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.626178 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.626259 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.626340 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.626581 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.626676 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.626866 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.626955 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.627185 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.627478 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.627585 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.627777 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.627865 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.628091 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.628183 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.628395 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.628492 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.628751 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.628917 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.629068 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.629259 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.629377 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.629568 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.629710 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.629970 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.630064 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.630292 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.630390 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.630629 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.630722 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.630933 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.631021 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.631235 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.631333 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.631540 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.631627 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.631839 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.631925 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.632144 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.632239 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.632447 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.632534 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.632746 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.632905 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.633061 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.633181 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.633346 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.633440 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.633649 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.633741 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.633947 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.634045 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.634246 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.634333 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.634559 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.634656 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.634868 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.634957 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.635171 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.635259 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.635468 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.635555 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.635766 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.635856 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.636070 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.636159 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.636367 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.636457 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.636662 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.636752 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.636961 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.637060 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.637256 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.637353 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.637557 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.637644 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.637852 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.637938 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.638152 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.638253 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.638450 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.638558 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.638775 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.638863 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.639071 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.639176 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.639374 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.639462 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.639713 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.639800 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.640029 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.640128 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.640326 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.640414 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.640626 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.640716 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.640934 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.641029 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.641239 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.641375 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.642090 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.642409 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.642614 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.642787 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.642942 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.643115 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.643287 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.643448 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.643602 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.643781 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.644090 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.644178 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.644398 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.644501 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.644708 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.644815 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.645031 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.645120 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.645343 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.645489 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.645655 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.645743 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.645967 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.646055 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.646284 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.646392 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.646611 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.646704 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.646925 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.647017 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.647234 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.647331 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.647543 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.647631 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.647848 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.647933 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.648152 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.648241 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.648457 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.648545 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.648761 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.648849 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.649066 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.649156 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.649371 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.649457 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.649675 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.649769 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.649979 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.650068 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.650282 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.650377 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.650608 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.650713 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.650920 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.651008 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.651243 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.651345 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.651555 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.651669 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.651861 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.651950 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.652169 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.652258 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.652477 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.652577 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.652782 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.652877 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.653085 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.653177 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.653390 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.653479 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.653695 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.653809 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.654012 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.654156 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.654307 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.654459 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.654641 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.654754 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.654918 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.655063 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.655329 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.655427 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.655641 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.655728 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.655955 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.656057 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.656270 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.656404 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.656574 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.656664 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.656890 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.656987 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.657751 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.657853 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.658149 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.658244 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.658477 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.658601 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.658812 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.658901 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.659119 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.659208 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.659425 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.659522 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.659736 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.659824 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.660058 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.660146 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.660367 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.660463 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.660670 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.660759 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.660975 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.661116 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.661287 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.661433 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.661571 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.661695 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.661877 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.661996 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.662180 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.662298 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.662465 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.662647 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.662811 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.662924 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.663091 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.663213 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.663420 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.663527 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.663736 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.663958 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.664134 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.664229 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.664343 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.664459 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.664573 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.664714 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.664868 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.665064 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.665200 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.665326 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.665480 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.665600 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.665743 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.665874 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.666033 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.666164 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.666339 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.666559 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.666699 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.666838 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.666960 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.667123 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.667239 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.667350 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.667512 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.667653 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.667813 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.667925 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.668128 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.668226 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.668455 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.668559 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.668765 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.668865 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.669153 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.669285 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.669444 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.669536 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.669687 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.669786 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.669992 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.670121 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.670308 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.670424 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.670640 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.670795 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.670951 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.671042 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.671242 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.671340 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.671569 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.671792 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.671887 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.671970 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.672172 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.672298 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.672455 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.672556 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.672776 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.672873 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.673155 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.673293 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.673554 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.673891 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.674121 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.674262 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.674426 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.674672 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.674899 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.675078 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.675239 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.675419 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.675551 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.675685 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.675862 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.675989 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.676158 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.676297 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.676465 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.676666 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.676850 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.676995 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.677161 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.677286 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.677461 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.677610 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.677739 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.677873 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.678014 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.678187 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.678317 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.678511 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.678682 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.678872 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.679036 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.679167 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.679320 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.679500 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.679633 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.679803 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.679929 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.680107 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.680244 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.680418 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.680552 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.680713 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.680860 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.681075 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.681223 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.681397 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.681537 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.681661 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.681823 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.682018 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.682166 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.682303 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.682440 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 21 10:37:00.682657 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.682657 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.682657 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.683008 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.683153 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:37:00.683393 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 21 10:37:00.746307 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: INFO dbcounter [None req-3c2a9c5b-b9e0-4dd1-a70d-d89ff61b9481 None None] Registered counter for database nova_api Jul 21 10:37:00.746812 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: INFO dbcounter [None req-6a16f677-b941-4b05-bb91-669c82062d37 None None] Registered counter for database nova_api Jul 21 10:37:00.862049 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG oslo_db.sqlalchemy.engines [None req-3c2a9c5b-b9e0-4dd1-a70d-d89ff61b9481 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110330) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 10:37:00.864022 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG oslo_db.sqlalchemy.engines [None req-6a16f677-b941-4b05-bb91-669c82062d37 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110329) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 10:37:00.868635 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG dbcounter [-] [110330] Writer thread running {{(pid=110330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 10:37:00.870662 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG dbcounter [-] [110329] Writer thread running {{(pid=110329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 10:37:00.925396 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.context [None req-3c2a9c5b-b9e0-4dd1-a70d-d89ff61b9481 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),67214de0-1644-4a2c-ab6c-aaec113708cb(cell1) {{(pid=110330) load_cells /opt/stack/nova/nova/context.py:464}} Jul 21 10:37:00.928114 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.context [None req-6a16f677-b941-4b05-bb91-669c82062d37 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),67214de0-1644-4a2c-ab6c-aaec113708cb(cell1) {{(pid=110329) load_cells /opt/stack/nova/nova/context.py:464}} Jul 21 10:37:00.929312 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG oslo_concurrency.lockutils [None req-3c2a9c5b-b9e0-4dd1-a70d-d89ff61b9481 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:37:00.930909 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG oslo_concurrency.lockutils [None req-3c2a9c5b-b9e0-4dd1-a70d-d89ff61b9481 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:37:00.931698 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG oslo_concurrency.lockutils [None req-3c2a9c5b-b9e0-4dd1-a70d-d89ff61b9481 None None] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:37:00.932074 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG oslo_concurrency.lockutils [None req-6a16f677-b941-4b05-bb91-669c82062d37 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:37:00.933700 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG oslo_concurrency.lockutils [None req-6a16f677-b941-4b05-bb91-669c82062d37 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:37:00.933894 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG oslo_concurrency.lockutils [None req-3c2a9c5b-b9e0-4dd1-a70d-d89ff61b9481 None None] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:37:00.934483 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG oslo_concurrency.lockutils [None req-6a16f677-b941-4b05-bb91-669c82062d37 None None] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:37:00.935928 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: INFO dbcounter [None req-3c2a9c5b-b9e0-4dd1-a70d-d89ff61b9481 None None] Registered counter for database nova_cell0 Jul 21 10:37:00.936646 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG oslo_concurrency.lockutils [None req-6a16f677-b941-4b05-bb91-669c82062d37 None None] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:37:00.939095 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: INFO dbcounter [None req-6a16f677-b941-4b05-bb91-669c82062d37 None None] Registered counter for database nova_cell0 Jul 21 10:37:00.939862 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: INFO dbcounter [None req-3c2a9c5b-b9e0-4dd1-a70d-d89ff61b9481 None None] Registered counter for database nova_cell1 Jul 21 10:37:00.943101 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: INFO dbcounter [None req-6a16f677-b941-4b05-bb91-669c82062d37 None None] Registered counter for database nova_cell1 Jul 21 10:37:00.949375 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG oslo_db.sqlalchemy.engines [None req-3c2a9c5b-b9e0-4dd1-a70d-d89ff61b9481 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110330) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 10:37:00.950146 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG oslo_db.sqlalchemy.engines [None req-3c2a9c5b-b9e0-4dd1-a70d-d89ff61b9481 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110330) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 10:37:00.950453 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG oslo_db.sqlalchemy.engines [None req-6a16f677-b941-4b05-bb91-669c82062d37 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110329) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 10:37:00.953502 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG oslo_db.sqlalchemy.engines [None req-6a16f677-b941-4b05-bb91-669c82062d37 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110329) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 10:37:00.955852 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG dbcounter [-] [110330] Writer thread running {{(pid=110330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 10:37:00.956066 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG dbcounter [-] [110329] Writer thread running {{(pid=110329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 10:37:01.096981 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG dbcounter [-] [110330] Writer thread running {{(pid=110330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 10:37:01.098993 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG dbcounter [-] [110329] Writer thread running {{(pid=110329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 10:37:01.106263 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: INFO dbcounter [None req-3c2a9c5b-b9e0-4dd1-a70d-d89ff61b9481 None None] Registered counter for database nova_cell0 Jul 21 10:37:01.108509 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: INFO dbcounter [None req-6a16f677-b941-4b05-bb91-669c82062d37 None None] Registered counter for database nova_cell0 Jul 21 10:37:01.116446 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG oslo_db.sqlalchemy.engines [None req-3c2a9c5b-b9e0-4dd1-a70d-d89ff61b9481 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110330) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 10:37:01.119556 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG oslo_db.sqlalchemy.engines [None req-6a16f677-b941-4b05-bb91-669c82062d37 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110329) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 10:37:01.121065 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG dbcounter [-] [110330] Writer thread running {{(pid=110330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 10:37:01.123905 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG dbcounter [-] [110329] Writer thread running {{(pid=110329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 10:37:01.529539 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: WARNING keystonemiddleware.auth_token [None req-3c2a9c5b-b9e0-4dd1-a70d-d89ff61b9481 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 21 10:37:01.537010 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: WARNING keystonemiddleware.auth_token [None req-3c2a9c5b-b9e0-4dd1-a70d-d89ff61b9481 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 21 10:37:01.662485 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: WARNING keystonemiddleware.auth_token [None req-6a16f677-b941-4b05-bb91-669c82062d37 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 21 10:37:01.669821 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: WARNING keystonemiddleware.auth_token [None req-6a16f677-b941-4b05-bb91-669c82062d37 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 21 10:37:01.874629 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: WARNING keystonemiddleware.auth_token [None req-3c2a9c5b-b9e0-4dd1-a70d-d89ff61b9481 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 21 10:37:01.881505 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: WARNING keystonemiddleware.auth_token [None req-3c2a9c5b-b9e0-4dd1-a70d-d89ff61b9481 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 21 10:37:01.886985 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55e6af0399c0 pid: 110330 (default app) Jul 21 10:37:01.889247 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi [None req-3c2a9c5b-b9e0-4dd1-a70d-d89ff61b9481 None None] Calling method '>' {{(pid=110330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:37:01.890460 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: INFO nova.api.openstack.requestlog [None req-3c2a9c5b-b9e0-4dd1-a70d-d89ff61b9481 None None] 10.222.0.48 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001902 Jul 21 10:37:01.890932 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: [pid: 110330|app: 0|req: 1/1] 10.222.0.48 () {50 vars in 788 bytes} [Thu Jul 21 10:37:01 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:37:02.018586 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: WARNING keystonemiddleware.auth_token [None req-6a16f677-b941-4b05-bb91-669c82062d37 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 21 10:37:02.024804 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: WARNING keystonemiddleware.auth_token [None req-6a16f677-b941-4b05-bb91-669c82062d37 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 21 10:37:02.030062 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e6af0399c0 pid: 110329 (default app) Jul 21 10:38:24.284038 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi [None req-3c2a9c5b-b9e0-4dd1-a70d-d89ff61b9481 None None] Calling method '>' {{(pid=110330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:38:24.285707 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: INFO nova.api.openstack.requestlog [None req-3c2a9c5b-b9e0-4dd1-a70d-d89ff61b9481 None None] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002564 Jul 21 10:38:24.291597 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: [pid: 110330|app: 0|req: 2/2] 10.222.0.48 () {54 vars in 930 bytes} [Thu Jul 21 10:38:24 2022] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:38:24.308450 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG dbcounter [-] [110329] Writing DB stats nova_api:SELECT=3 {{(pid=110329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:38:24.309921 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG dbcounter [-] [110329] Writing DB stats nova_cell1:SELECT=3 {{(pid=110329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:38:24.310860 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG dbcounter [-] [110329] Writing DB stats nova_cell0:SELECT=3 {{(pid=110329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:38:24.312126 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG dbcounter [-] [110329] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:38:25.213038 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi [None req-43094a26-89df-4173-8f59-e4a3c0c94095 admin admin] Calling method '>' {{(pid=110329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:38:25.245595 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: INFO nova.api.openstack.requestlog [None req-43094a26-89df-4173-8f59-e4a3c0c94095 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.951651 Jul 21 10:38:25.246523 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: [pid: 110329|app: 0|req: 1/3] 10.222.0.48 () {60 vars in 1291 bytes} [Thu Jul 21 10:38:24 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:38:27.651020 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi [None req-3c2a9c5b-b9e0-4dd1-a70d-d89ff61b9481 None None] Calling method '>' {{(pid=110330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:38:27.652031 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: INFO nova.api.openstack.requestlog [None req-3c2a9c5b-b9e0-4dd1-a70d-d89ff61b9481 None None] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Jul 21 10:38:27.652458 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: [pid: 110330|app: 0|req: 3/4] 10.222.0.48 () {54 vars in 930 bytes} [Thu Jul 21 10:38:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:38:28.212748 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi [None req-9d1412e9-b400-4e66-a04f-bdeb14ecb788 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "cirros256", "os-flavor-access:is_public": true, "swap": 0, "vcpus": 1, "disk": 1, "id": "c1"}} {{(pid=110329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:38:28.231688 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 10:38:28.231688 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: warnings.warn(msg) Jul 21 10:38:28.319640 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: INFO nova.api.openstack.requestlog [None req-9d1412e9-b400-4e66-a04f-bdeb14ecb788 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.660261 Jul 21 10:38:28.320216 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: [pid: 110329|app: 0|req: 2/5] 10.222.0.48 () {64 vars in 1282 bytes} [Thu Jul 21 10:38:27 2022] POST /compute/v2.1/flavors => generated 407 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 21 10:38:28.540849 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi [None req-67fe6909-cd93-473b-84ad-805af233f433 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:38:28.543500 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 10:38:28.543500 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: warnings.warn(msg) Jul 21 10:38:28.564591 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG dbcounter [-] [110330] Writing DB stats nova_api:SELECT=3 {{(pid=110330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:38:28.565512 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG dbcounter [-] [110330] Writing DB stats nova_cell0:SELECT=3 {{(pid=110330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:38:28.566347 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG dbcounter [-] [110330] Writing DB stats nova_cell1:SELECT=3 {{(pid=110330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:38:28.567113 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG dbcounter [-] [110330] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:38:28.677123 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: INFO nova.api.openstack.requestlog [None req-67fe6909-cd93-473b-84ad-805af233f433 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.347915 Jul 21 10:38:28.678037 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: [pid: 110330|app: 0|req: 4/6] 10.222.0.48 () {64 vars in 1335 bytes} [Thu Jul 21 10:38:28 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:38:30.939633 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi [None req-9d1412e9-b400-4e66-a04f-bdeb14ecb788 admin admin] Calling method '>' {{(pid=110329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:38:30.940647 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: INFO nova.api.openstack.requestlog [None req-9d1412e9-b400-4e66-a04f-bdeb14ecb788 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001552 Jul 21 10:38:30.941242 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: [pid: 110329|app: 0|req: 3/7] 10.222.0.48 () {54 vars in 930 bytes} [Thu Jul 21 10:38:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:38:31.607752 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi [None req-10639786-1bf3-4d6d-9657-decf179e92af admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "id": "d1", "swap": 0, "name": "ds512M", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 512}} {{(pid=110330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:38:31.626737 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 10:38:31.626737 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: warnings.warn(msg) Jul 21 10:38:31.724998 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: INFO nova.api.openstack.requestlog [None req-10639786-1bf3-4d6d-9657-decf179e92af admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.777674 Jul 21 10:38:31.730583 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: [pid: 110330|app: 0|req: 5/8] 10.222.0.48 () {64 vars in 1282 bytes} [Thu Jul 21 10:38:30 2022] POST /compute/v2.1/flavors => generated 404 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 10:38:31.738414 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi [None req-aba57147-bd8e-48cf-9ea8-0c52d75d8eb0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:38:31.740133 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 10:38:31.740133 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: warnings.warn(msg) Jul 21 10:38:31.825341 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: INFO nova.api.openstack.requestlog [None req-aba57147-bd8e-48cf-9ea8-0c52d75d8eb0 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.090837 Jul 21 10:38:31.830723 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: [pid: 110329|app: 0|req: 4/9] 10.222.0.48 () {64 vars in 1335 bytes} [Thu Jul 21 10:38:31 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:38:34.153444 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi [None req-10639786-1bf3-4d6d-9657-decf179e92af admin admin] Calling method '>' {{(pid=110330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:38:34.154448 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: INFO nova.api.openstack.requestlog [None req-10639786-1bf3-4d6d-9657-decf179e92af admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Jul 21 10:38:34.154928 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: [pid: 110330|app: 0|req: 6/10] 10.222.0.48 () {54 vars in 930 bytes} [Thu Jul 21 10:38:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:38:34.580016 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi [None req-c58025b7-f6a7-443a-9aba-065df5ff834b admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 1, "rxtx_factor": 1.0, "name": "ds1G", "os-flavor-access:is_public": true, "disk": 10, "ram": 1024, "id": "d2"}} {{(pid=110329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:38:34.673668 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: INFO nova.api.openstack.requestlog [None req-c58025b7-f6a7-443a-9aba-065df5ff834b admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.512335 Jul 21 10:38:34.674211 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: [pid: 110329|app: 0|req: 5/11] 10.222.0.48 () {64 vars in 1282 bytes} [Thu Jul 21 10:38:34 2022] POST /compute/v2.1/flavors => generated 404 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 10:38:34.685953 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi [None req-0365c5a2-cbca-44a0-a5f3-43f34c62366a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:38:34.767805 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: INFO nova.api.openstack.requestlog [None req-0365c5a2-cbca-44a0-a5f3-43f34c62366a admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.085327 Jul 21 10:38:34.768306 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: [pid: 110330|app: 0|req: 7/12] 10.222.0.48 () {64 vars in 1335 bytes} [Thu Jul 21 10:38:34 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:38:37.057709 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi [None req-c58025b7-f6a7-443a-9aba-065df5ff834b admin admin] Calling method '>' {{(pid=110329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:38:37.058911 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: INFO nova.api.openstack.requestlog [None req-c58025b7-f6a7-443a-9aba-065df5ff834b admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001954 Jul 21 10:38:37.059491 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: [pid: 110329|app: 0|req: 6/13] 10.222.0.48 () {54 vars in 930 bytes} [Thu Jul 21 10:38:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:38:37.559047 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi [None req-53acdf8b-52f2-4af1-b0a6-f36744e1cc72 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 2, "swap": 0, "id": "d3"}} {{(pid=110330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:38:37.695817 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: INFO nova.api.openstack.requestlog [None req-53acdf8b-52f2-4af1-b0a6-f36744e1cc72 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.629178 Jul 21 10:38:37.696407 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: [pid: 110330|app: 0|req: 8/14] 10.222.0.48 () {64 vars in 1282 bytes} [Thu Jul 21 10:38:37 2022] POST /compute/v2.1/flavors => generated 404 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 10:38:37.708766 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi [None req-e9f96c46-e236-4091-a9a4-966e1783e3dc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:38:37.796515 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: INFO nova.api.openstack.requestlog [None req-e9f96c46-e236-4091-a9a4-966e1783e3dc admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091191 Jul 21 10:38:37.797233 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: [pid: 110329|app: 0|req: 7/15] 10.222.0.48 () {64 vars in 1335 bytes} [Thu Jul 21 10:38:37 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:38:40.103142 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi [None req-53acdf8b-52f2-4af1-b0a6-f36744e1cc72 admin admin] Calling method '>' {{(pid=110330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:38:40.104151 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: INFO nova.api.openstack.requestlog [None req-53acdf8b-52f2-4af1-b0a6-f36744e1cc72 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Jul 21 10:38:40.104550 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: [pid: 110330|app: 0|req: 9/16] 10.222.0.48 () {54 vars in 930 bytes} [Thu Jul 21 10:38:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:38:40.583436 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi [None req-2b38d253-ae63-4ba1-93ec-eb39b231ee58 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 4096, "id": "d4", "vcpus": 4, "swap": 0}} {{(pid=110329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:38:40.661887 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: INFO nova.api.openstack.requestlog [None req-2b38d253-ae63-4ba1-93ec-eb39b231ee58 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.550668 Jul 21 10:38:40.662820 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: [pid: 110329|app: 0|req: 8/17] 10.222.0.48 () {64 vars in 1282 bytes} [Thu Jul 21 10:38:40 2022] POST /compute/v2.1/flavors => generated 404 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 10:38:40.675604 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi [None req-50ce1570-f9bf-480e-99a0-b85196cf3662 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:38:40.758361 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: INFO nova.api.openstack.requestlog [None req-50ce1570-f9bf-480e-99a0-b85196cf3662 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.086936 Jul 21 10:38:40.759291 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: [pid: 110330|app: 0|req: 10/18] 10.222.0.48 () {64 vars in 1335 bytes} [Thu Jul 21 10:38:40 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:38:43.174441 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi [None req-2b38d253-ae63-4ba1-93ec-eb39b231ee58 admin admin] Calling method '>' {{(pid=110329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:38:43.175494 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: INFO nova.api.openstack.requestlog [None req-2b38d253-ae63-4ba1-93ec-eb39b231ee58 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Jul 21 10:38:43.175910 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: [pid: 110329|app: 0|req: 9/19] 10.222.0.48 () {54 vars in 930 bytes} [Thu Jul 21 10:38:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:38:43.681998 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi [None req-2b443342-2b4b-42a3-9b78-dd625b45efa4 admin admin] Calling method '>' {{(pid=110330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:38:43.706152 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: INFO nova.api.openstack.requestlog [None req-2b443342-2b4b-42a3-9b78-dd625b45efa4 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.523826 Jul 21 10:38:43.706743 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: [pid: 110330|app: 0|req: 11/20] 10.222.0.48 () {60 vars in 1291 bytes} [Thu Jul 21 10:38:43 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:38:46.087113 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi [None req-2b38d253-ae63-4ba1-93ec-eb39b231ee58 admin admin] Calling method '>' {{(pid=110329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:38:46.088416 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: INFO nova.api.openstack.requestlog [None req-2b38d253-ae63-4ba1-93ec-eb39b231ee58 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001950 Jul 21 10:38:46.088957 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: [pid: 110329|app: 0|req: 10/21] 10.222.0.48 () {54 vars in 930 bytes} [Thu Jul 21 10:38:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:38:46.627158 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi [None req-ef850d13-879d-486f-aab2-ed1e82ead1a3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "swap": 0, "rxtx_factor": 1.0, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "m1.tiny", "id": "1", "vcpus": 1}} {{(pid=110330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:38:46.709376 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: INFO nova.api.openstack.requestlog [None req-ef850d13-879d-486f-aab2-ed1e82ead1a3 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.612789 Jul 21 10:38:46.710255 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: [pid: 110330|app: 0|req: 12/22] 10.222.0.48 () {64 vars in 1282 bytes} [Thu Jul 21 10:38:46 2022] POST /compute/v2.1/flavors => generated 402 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 21 10:38:46.724971 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi [None req-ae35085e-f304-47c3-8bc0-b861ab155001 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:38:46.805740 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: INFO nova.api.openstack.requestlog [None req-ae35085e-f304-47c3-8bc0-b861ab155001 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.085046 Jul 21 10:38:46.814633 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: [pid: 110329|app: 0|req: 11/23] 10.222.0.48 () {64 vars in 1332 bytes} [Thu Jul 21 10:38:46 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:38:49.133367 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi [None req-ef850d13-879d-486f-aab2-ed1e82ead1a3 admin admin] Calling method '>' {{(pid=110330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:38:49.134384 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: INFO nova.api.openstack.requestlog [None req-ef850d13-879d-486f-aab2-ed1e82ead1a3 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Jul 21 10:38:49.134852 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: [pid: 110330|app: 0|req: 13/24] 10.222.0.48 () {54 vars in 930 bytes} [Thu Jul 21 10:38:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 10:38:49.539186 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi [None req-0a9af293-944d-4f23-a15d-e0540d0a15ff admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 20, "ram": 2048, "vcpus": 1}} {{(pid=110329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:38:49.616072 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: INFO nova.api.openstack.requestlog [None req-0a9af293-944d-4f23-a15d-e0540d0a15ff admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.475060 Jul 21 10:38:49.616640 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: [pid: 110329|app: 0|req: 12/25] 10.222.0.48 () {64 vars in 1282 bytes} [Thu Jul 21 10:38:49 2022] POST /compute/v2.1/flavors => generated 405 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 10:38:49.628992 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi [None req-c96b5b3c-641b-4b9b-a12a-6569647c1834 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:38:49.716353 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: INFO nova.api.openstack.requestlog [None req-c96b5b3c-641b-4b9b-a12a-6569647c1834 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091391 Jul 21 10:38:49.716930 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: [pid: 110330|app: 0|req: 14/26] 10.222.0.48 () {64 vars in 1332 bytes} [Thu Jul 21 10:38:49 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:38:52.021462 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi [None req-0a9af293-944d-4f23-a15d-e0540d0a15ff admin admin] Calling method '>' {{(pid=110329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:38:52.022510 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: INFO nova.api.openstack.requestlog [None req-0a9af293-944d-4f23-a15d-e0540d0a15ff admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Jul 21 10:38:52.023123 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: [pid: 110329|app: 0|req: 13/27] 10.222.0.48 () {54 vars in 930 bytes} [Thu Jul 21 10:38:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:38:52.417476 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi [None req-08e0ad96-0f37-4002-9f15-f930f01f2ead admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "vcpus": 2, "disk": 40, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 4096}} {{(pid=110330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:38:52.495325 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: INFO nova.api.openstack.requestlog [None req-08e0ad96-0f37-4002-9f15-f930f01f2ead admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.466139 Jul 21 10:38:52.495881 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: [pid: 110330|app: 0|req: 15/28] 10.222.0.48 () {64 vars in 1282 bytes} [Thu Jul 21 10:38:52 2022] POST /compute/v2.1/flavors => generated 406 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 10:38:52.508664 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi [None req-d58a9b63-d31f-4ba2-9b23-6f31d375b7a4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:38:52.579244 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: INFO nova.api.openstack.requestlog [None req-d58a9b63-d31f-4ba2-9b23-6f31d375b7a4 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.074183 Jul 21 10:38:52.579837 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: [pid: 110329|app: 0|req: 14/29] 10.222.0.48 () {64 vars in 1332 bytes} [Thu Jul 21 10:38:52 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:38:54.955812 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi [None req-08e0ad96-0f37-4002-9f15-f930f01f2ead admin admin] Calling method '>' {{(pid=110330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:38:54.956860 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: INFO nova.api.openstack.requestlog [None req-08e0ad96-0f37-4002-9f15-f930f01f2ead admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Jul 21 10:38:54.958647 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: [pid: 110330|app: 0|req: 16/30] 10.222.0.48 () {54 vars in 930 bytes} [Thu Jul 21 10:38:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:38:55.572080 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi [None req-e3ea297c-5710-4c84-917d-aa96375ed844 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "disk": 80, "id": "4", "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "ram": 8192}} {{(pid=110329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:38:55.578174 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG dbcounter [-] [110329] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=110329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:38:55.700951 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: INFO nova.api.openstack.requestlog [None req-e3ea297c-5710-4c84-917d-aa96375ed844 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.737444 Jul 21 10:38:55.701432 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: [pid: 110329|app: 0|req: 15/31] 10.222.0.48 () {64 vars in 1282 bytes} [Thu Jul 21 10:38:54 2022] POST /compute/v2.1/flavors => generated 405 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 10:38:55.715839 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi [None req-3375b731-107a-4e0c-a85d-c9517fe68e6f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:38:55.841864 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: INFO nova.api.openstack.requestlog [None req-3375b731-107a-4e0c-a85d-c9517fe68e6f admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.131662 Jul 21 10:38:55.843575 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: [pid: 110330|app: 0|req: 17/32] 10.222.0.48 () {64 vars in 1332 bytes} [Thu Jul 21 10:38:55 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:38:58.237124 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi [None req-e3ea297c-5710-4c84-917d-aa96375ed844 admin admin] Calling method '>' {{(pid=110329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:38:58.238882 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: INFO nova.api.openstack.requestlog [None req-e3ea297c-5710-4c84-917d-aa96375ed844 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002299 Jul 21 10:38:58.239361 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: [pid: 110329|app: 0|req: 16/33] 10.222.0.48 () {54 vars in 930 bytes} [Thu Jul 21 10:38:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:38:58.741663 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi [None req-ac65c1c1-3de9-43ba-9312-14b433962963 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "5", "swap": 0, "vcpus": 8, "name": "m1.xlarge"}} {{(pid=110330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:38:58.746033 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG dbcounter [-] [110330] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=110330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:38:58.863193 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: INFO nova.api.openstack.requestlog [None req-ac65c1c1-3de9-43ba-9312-14b433962963 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.617245 Jul 21 10:38:58.864038 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: [pid: 110330|app: 0|req: 18/34] 10.222.0.48 () {64 vars in 1282 bytes} [Thu Jul 21 10:38:58 2022] POST /compute/v2.1/flavors => generated 408 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 10:38:58.877208 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi [None req-d42bae99-98d6-43ca-b349-1255e831d315 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:38:58.968471 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: INFO nova.api.openstack.requestlog [None req-d42bae99-98d6-43ca-b349-1255e831d315 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.095884 Jul 21 10:38:58.969460 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: [pid: 110329|app: 0|req: 17/35] 10.222.0.48 () {64 vars in 1332 bytes} [Thu Jul 21 10:38:58 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:39:19.115114 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi [None req-ac65c1c1-3de9-43ba-9312-14b433962963 admin admin] Calling method '>' {{(pid=110330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:39:19.116128 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: INFO nova.api.openstack.requestlog [None req-ac65c1c1-3de9-43ba-9312-14b433962963 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001516 Jul 21 10:39:19.116532 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: [pid: 110330|app: 0|req: 19/36] 10.222.0.48 () {54 vars in 930 bytes} [Thu Jul 21 10:39:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:39:19.566099 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi [None req-019dae45-2d88-4ac4-b990-71c967b4c8ca admin admin] Calling method '>' {{(pid=110329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:39:19.583476 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: INFO nova.api.openstack.requestlog [None req-019dae45-2d88-4ac4-b990-71c967b4c8ca admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.460894 Jul 21 10:39:19.584010 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: [pid: 110329|app: 0|req: 18/37] 10.222.0.48 () {60 vars in 1291 bytes} [Thu Jul 21 10:39:19 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:39:20.671423 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi [None req-ac65c1c1-3de9-43ba-9312-14b433962963 admin admin] Calling method '>' {{(pid=110330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:39:20.675081 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: INFO nova.api.openstack.requestlog [None req-ac65c1c1-3de9-43ba-9312-14b433962963 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002223 Jul 21 10:39:20.675081 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: [pid: 110330|app: 0|req: 20/38] 10.222.0.48 () {56 vars in 1074 bytes} [Thu Jul 21 10:39:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:39:21.262913 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi [None req-045bbbff-db76-4265-b4ae-88597267cdc0 admin admin] Calling method '>' {{(pid=110329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:39:21.269519 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: INFO nova.api.openstack.wsgi [None req-045bbbff-db76-4265-b4ae-88597267cdc0 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 21 10:39:21.274129 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi [None req-045bbbff-db76-4265-b4ae-88597267cdc0 admin admin] Request method failure captured: Jul 21 10:39:21.274129 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 21 10:39:21.274129 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: Accept: application/json Jul 21 10:39:21.274129 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: Accept-Encoding: gzip, deflate Jul 21 10:39:21.274129 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: Connection: keep-alive Jul 21 10:39:21.274129 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: Content-Length: 0 Jul 21 10:39:21.274129 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: Host: 10.222.0.48 Jul 21 10:39:21.274129 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: Openstack-Api-Version: compute 2.90 Jul 21 10:39:21.274129 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: Openstack-System-Scope: None Jul 21 10:39:21.274129 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: User-Agent: python-novaclient Jul 21 10:39:21.274129 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: X-Auth-Token: gAAAAABi2SzY6SxRdqracLIIvR-lG4SkvUqaSSvhy8SasvAXc3ePsYkHxcl5G7icOae_XRU0gkMjeiGjoDIWwcKzMs1MQg3aKPe-DoSffMwuQgGsfAe0Rna-bhk6F0efHaZoTAFZD45okuwxl2raSHSw-mwAH6r7KAppQf5OPpJrlEYCRrptEY8 Jul 21 10:39:21.274129 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: X-Domain-Id: None Jul 21 10:39:21.274129 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: X-Domain-Name: None Jul 21 10:39:21.274129 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: X-Identity-Status: Confirmed Jul 21 10:39:21.274129 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: X-Is-Admin-Project: True Jul 21 10:39:21.274129 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: X-Openstack-Nova-Api-Version: 2.90 Jul 21 10:39:21.274129 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: X-Project-Domain-Id: default Jul 21 10:39:21.274129 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: X-Project-Domain-Name: Default Jul 21 10:39:21.274129 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: X-Project-Id: 549a3510fe3f48278464436ac5f2a88c Jul 21 10:39:21.274129 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: X-Project-Name: admin Jul 21 10:39:21.274129 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: X-Role: admin,reader,member Jul 21 10:39:21.274129 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: X-Roles: admin,reader,member Jul 21 10:39:21.275540 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/549a3510fe3f48278464436ac5f2a88c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/549a3510fe3f48278464436ac5f2a88c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/549a3510fe3f48278464436ac5f2a88c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_549a3510fe3f48278464436ac5f2a88c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] Jul 21 10:39:21.275540 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: X-Tenant: admin Jul 21 10:39:21.275540 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: X-Tenant-Id: 549a3510fe3f48278464436ac5f2a88c Jul 21 10:39:21.275540 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: X-Tenant-Name: admin Jul 21 10:39:21.275540 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: X-User: admin Jul 21 10:39:21.275540 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: X-User-Domain-Id: default Jul 21 10:39:21.275540 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: X-User-Domain-Name: Default Jul 21 10:39:21.275540 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: X-User-Id: 1db1bf9bea374f37b124738f1edc4d39 Jul 21 10:39:21.275540 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: X-User-Name: admin Jul 21 10:39:21.275540 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: method: > Jul 21 10:39:21.275540 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: exception: Flavor 42 could not be found. Jul 21 10:39:21.275540 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: action_args: {'id': '42'} Jul 21 10:39:21.275540 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: {{(pid=110329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 10:39:21.275540 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:39:21.276545 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 21 10:39:21.276545 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 21 10:39:21.276545 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 21 10:39:21.276545 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 21 10:39:21.276545 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 21 10:39:21.276545 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 21 10:39:21.276545 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 21 10:39:21.276545 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 21 10:39:21.276545 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 21 10:39:21.276545 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 10:39:21.276545 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 21 10:39:21.276545 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 21 10:39:21.276545 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 21 10:39:21.276545 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: ERROR nova.api.openstack.wsgi Jul 21 10:39:21.276545 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:39:21.276545 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: ERROR nova.api.openstack.wsgi Jul 21 10:39:21.276545 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:39:21.276545 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:39:21.276545 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:39:21.277655 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 10:39:21.277655 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 10:39:21.277655 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 10:39:21.277655 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 10:39:21.277655 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 21 10:39:21.277655 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 21 10:39:21.277655 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 21 10:39:21.277655 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: ERROR nova.api.openstack.wsgi Jul 21 10:39:21.277655 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:39:21.277655 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: ERROR nova.api.openstack.wsgi Jul 21 10:39:21.277655 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:39:21.277655 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:39:21.277655 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:39:21.277655 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 10:39:21.277655 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 10:39:21.277655 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 21 10:39:21.277655 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: ERROR nova.api.openstack.wsgi Jul 21 10:39:21.277655 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi [None req-045bbbff-db76-4265-b4ae-88597267cdc0 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110329) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 10:39:21.278743 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: INFO nova.api.openstack.requestlog [None req-045bbbff-db76-4265-b4ae-88597267cdc0 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.462343 Jul 21 10:39:21.278743 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: [pid: 110329|app: 0|req: 19/39] 10.222.0.48 () {60 vars in 1190 bytes} [Thu Jul 21 10:39:20 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 463 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 21 10:39:21.284741 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi [None req-7e1b63d2-f4f3-46f4-94b2-1f75f24fd7af admin admin] Calling method '>' {{(pid=110330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:39:21.307006 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: INFO nova.api.openstack.requestlog [None req-7e1b63d2-f4f3-46f4-94b2-1f75f24fd7af admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025761 Jul 21 10:39:21.308747 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: [pid: 110330|app: 0|req: 21/40] 10.222.0.48 () {60 vars in 1210 bytes} [Thu Jul 21 10:39:21 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:39:21.318054 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi [None req-b6b431ff-ee6d-4e3c-b018-cd710ced15a9 admin admin] Calling method '>' {{(pid=110329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:39:21.340326 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: INFO nova.api.openstack.requestlog [None req-b6b431ff-ee6d-4e3c-b018-cd710ced15a9 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025786 Jul 21 10:39:21.340899 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: [pid: 110329|app: 0|req: 20/41] 10.222.0.48 () {60 vars in 1210 bytes} [Thu Jul 21 10:39:21 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:39:21.350987 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi [None req-f173adc3-a212-4fa7-bb52-2f733290157e admin admin] Calling method '>' {{(pid=110330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:39:21.357653 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: INFO nova.api.openstack.wsgi [None req-f173adc3-a212-4fa7-bb52-2f733290157e admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 21 10:39:21.360956 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi [None req-f173adc3-a212-4fa7-bb52-2f733290157e admin admin] Request method failure captured: Jul 21 10:39:21.360956 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 21 10:39:21.360956 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: Accept: application/json Jul 21 10:39:21.360956 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: Accept-Encoding: gzip, deflate Jul 21 10:39:21.360956 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: Connection: keep-alive Jul 21 10:39:21.360956 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: Content-Length: 0 Jul 21 10:39:21.360956 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: Host: 10.222.0.48 Jul 21 10:39:21.360956 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: Openstack-Api-Version: compute 2.90 Jul 21 10:39:21.360956 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: Openstack-System-Scope: None Jul 21 10:39:21.360956 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: User-Agent: python-novaclient Jul 21 10:39:21.360956 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: X-Auth-Token: gAAAAABi2SzY6SxRdqracLIIvR-lG4SkvUqaSSvhy8SasvAXc3ePsYkHxcl5G7icOae_XRU0gkMjeiGjoDIWwcKzMs1MQg3aKPe-DoSffMwuQgGsfAe0Rna-bhk6F0efHaZoTAFZD45okuwxl2raSHSw-mwAH6r7KAppQf5OPpJrlEYCRrptEY8 Jul 21 10:39:21.360956 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: X-Domain-Id: None Jul 21 10:39:21.360956 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: X-Domain-Name: None Jul 21 10:39:21.360956 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: X-Identity-Status: Confirmed Jul 21 10:39:21.360956 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: X-Is-Admin-Project: True Jul 21 10:39:21.360956 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: X-Openstack-Nova-Api-Version: 2.90 Jul 21 10:39:21.360956 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: X-Project-Domain-Id: default Jul 21 10:39:21.360956 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: X-Project-Domain-Name: Default Jul 21 10:39:21.360956 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: X-Project-Id: 549a3510fe3f48278464436ac5f2a88c Jul 21 10:39:21.360956 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: X-Project-Name: admin Jul 21 10:39:21.360956 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: X-Role: admin,reader,member Jul 21 10:39:21.360956 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: X-Roles: admin,reader,member Jul 21 10:39:21.362607 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/549a3510fe3f48278464436ac5f2a88c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/549a3510fe3f48278464436ac5f2a88c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/549a3510fe3f48278464436ac5f2a88c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_549a3510fe3f48278464436ac5f2a88c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] Jul 21 10:39:21.362607 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: X-Tenant: admin Jul 21 10:39:21.362607 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: X-Tenant-Id: 549a3510fe3f48278464436ac5f2a88c Jul 21 10:39:21.362607 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: X-Tenant-Name: admin Jul 21 10:39:21.362607 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: X-User: admin Jul 21 10:39:21.362607 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: X-User-Domain-Id: default Jul 21 10:39:21.362607 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: X-User-Domain-Name: Default Jul 21 10:39:21.362607 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: X-User-Id: 1db1bf9bea374f37b124738f1edc4d39 Jul 21 10:39:21.362607 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: X-User-Name: admin Jul 21 10:39:21.362607 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: method: > Jul 21 10:39:21.362607 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: exception: Flavor 42 could not be found. Jul 21 10:39:21.362607 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: action_args: {'id': '42'} Jul 21 10:39:21.362607 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: {{(pid=110330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 10:39:21.362607 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:39:21.363534 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 21 10:39:21.363534 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 21 10:39:21.363534 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 21 10:39:21.363534 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 21 10:39:21.363534 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 21 10:39:21.363534 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 21 10:39:21.363534 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 21 10:39:21.363534 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 21 10:39:21.363534 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 21 10:39:21.363534 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 10:39:21.363534 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 21 10:39:21.363534 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 21 10:39:21.363534 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 21 10:39:21.363534 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: ERROR nova.api.openstack.wsgi Jul 21 10:39:21.363534 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:39:21.363534 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: ERROR nova.api.openstack.wsgi Jul 21 10:39:21.363534 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:39:21.363534 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:39:21.363534 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:39:21.364648 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 10:39:21.364648 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 10:39:21.364648 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 10:39:21.364648 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 10:39:21.364648 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 21 10:39:21.364648 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 21 10:39:21.364648 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 21 10:39:21.364648 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: ERROR nova.api.openstack.wsgi Jul 21 10:39:21.364648 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:39:21.364648 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: ERROR nova.api.openstack.wsgi Jul 21 10:39:21.364648 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:39:21.364648 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:39:21.364648 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:39:21.364648 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 10:39:21.364648 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 10:39:21.364648 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 21 10:39:21.364648 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: ERROR nova.api.openstack.wsgi Jul 21 10:39:21.364648 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi [None req-f173adc3-a212-4fa7-bb52-2f733290157e admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110330) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 10:39:21.365684 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: INFO nova.api.openstack.requestlog [None req-f173adc3-a212-4fa7-bb52-2f733290157e admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015438 Jul 21 10:39:21.365684 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: [pid: 110330|app: 0|req: 22/42] 10.222.0.48 () {60 vars in 1190 bytes} [Thu Jul 21 10:39:21 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 21 10:39:22.367018 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi [None req-b6b431ff-ee6d-4e3c-b018-cd710ced15a9 admin admin] Calling method '>' {{(pid=110329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:39:22.368137 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: INFO nova.api.openstack.requestlog [None req-b6b431ff-ee6d-4e3c-b018-cd710ced15a9 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001589 Jul 21 10:39:22.368624 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: [pid: 110329|app: 0|req: 21/43] 10.222.0.48 () {56 vars in 1074 bytes} [Thu Jul 21 10:39:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:39:22.913298 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi [None req-f598e03e-5dc5-4e49-9346-189604257f52 admin admin] Calling method '>' {{(pid=110330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:39:22.919268 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: INFO nova.api.openstack.wsgi [None req-f598e03e-5dc5-4e49-9346-189604257f52 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 21 10:39:22.921345 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi [None req-f598e03e-5dc5-4e49-9346-189604257f52 admin admin] Request method failure captured: Jul 21 10:39:22.921345 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 21 10:39:22.921345 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: Accept: application/json Jul 21 10:39:22.921345 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: Accept-Encoding: gzip, deflate Jul 21 10:39:22.921345 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: Connection: keep-alive Jul 21 10:39:22.921345 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: Content-Length: 0 Jul 21 10:39:22.921345 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: Host: 10.222.0.48 Jul 21 10:39:22.921345 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: Openstack-Api-Version: compute 2.90 Jul 21 10:39:22.921345 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: Openstack-System-Scope: None Jul 21 10:39:22.921345 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: User-Agent: python-novaclient Jul 21 10:39:22.921345 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: X-Auth-Token: gAAAAABi2SzaekA1J7FbqJcxBR8M7lfx4HVeeWnjTwkRuBSPOpSCIZ7klVYNg7EKSVCvlQq52STt-J2UX162-Rfy5N4hV64FdxSYiWMsT2zDIrtXuWPXiu2oGSSCx1GCAfvdUhM84Gmp_wener2LspDn3az_MtbjHnGZ6hSuWvOa7JrUE7A2Y_U Jul 21 10:39:22.921345 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: X-Domain-Id: None Jul 21 10:39:22.921345 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: X-Domain-Name: None Jul 21 10:39:22.921345 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: X-Identity-Status: Confirmed Jul 21 10:39:22.921345 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: X-Is-Admin-Project: True Jul 21 10:39:22.921345 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: X-Openstack-Nova-Api-Version: 2.90 Jul 21 10:39:22.921345 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: X-Project-Domain-Id: default Jul 21 10:39:22.921345 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: X-Project-Domain-Name: Default Jul 21 10:39:22.921345 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: X-Project-Id: 549a3510fe3f48278464436ac5f2a88c Jul 21 10:39:22.921345 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: X-Project-Name: admin Jul 21 10:39:22.921345 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: X-Role: admin,reader,member Jul 21 10:39:22.921345 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: X-Roles: admin,reader,member Jul 21 10:39:22.922818 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/549a3510fe3f48278464436ac5f2a88c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/549a3510fe3f48278464436ac5f2a88c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/549a3510fe3f48278464436ac5f2a88c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_549a3510fe3f48278464436ac5f2a88c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] Jul 21 10:39:22.922818 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: X-Tenant: admin Jul 21 10:39:22.922818 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: X-Tenant-Id: 549a3510fe3f48278464436ac5f2a88c Jul 21 10:39:22.922818 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: X-Tenant-Name: admin Jul 21 10:39:22.922818 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: X-User: admin Jul 21 10:39:22.922818 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: X-User-Domain-Id: default Jul 21 10:39:22.922818 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: X-User-Domain-Name: Default Jul 21 10:39:22.922818 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: X-User-Id: 1db1bf9bea374f37b124738f1edc4d39 Jul 21 10:39:22.922818 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: X-User-Name: admin Jul 21 10:39:22.922818 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: method: > Jul 21 10:39:22.922818 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: exception: Flavor 84 could not be found. Jul 21 10:39:22.922818 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: action_args: {'id': '84'} Jul 21 10:39:22.922818 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: {{(pid=110330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 10:39:22.922818 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:39:22.923620 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 21 10:39:22.923620 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 21 10:39:22.923620 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 21 10:39:22.923620 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 21 10:39:22.923620 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 21 10:39:22.923620 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 21 10:39:22.923620 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 21 10:39:22.923620 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 21 10:39:22.923620 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 21 10:39:22.923620 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 10:39:22.923620 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 21 10:39:22.923620 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 21 10:39:22.923620 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 21 10:39:22.923620 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: ERROR nova.api.openstack.wsgi Jul 21 10:39:22.923620 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:39:22.923620 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: ERROR nova.api.openstack.wsgi Jul 21 10:39:22.923620 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:39:22.923620 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:39:22.923620 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:39:22.924881 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 10:39:22.924881 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 10:39:22.924881 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 10:39:22.924881 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 10:39:22.924881 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 21 10:39:22.924881 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 21 10:39:22.924881 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 21 10:39:22.924881 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: ERROR nova.api.openstack.wsgi Jul 21 10:39:22.924881 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:39:22.924881 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: ERROR nova.api.openstack.wsgi Jul 21 10:39:22.924881 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:39:22.924881 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:39:22.924881 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:39:22.924881 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 10:39:22.924881 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 10:39:22.924881 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 21 10:39:22.924881 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: ERROR nova.api.openstack.wsgi Jul 21 10:39:22.924881 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi [None req-f598e03e-5dc5-4e49-9346-189604257f52 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110330) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 10:39:22.926129 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: INFO nova.api.openstack.requestlog [None req-f598e03e-5dc5-4e49-9346-189604257f52 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.413509 Jul 21 10:39:22.926129 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: [pid: 110330|app: 0|req: 23/44] 10.222.0.48 () {60 vars in 1190 bytes} [Thu Jul 21 10:39:22 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 415 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 21 10:39:22.932424 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi [None req-472dd0be-fa6a-44e4-8757-defd9bdeca2a admin admin] Calling method '>' {{(pid=110329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:39:22.946582 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: INFO nova.api.openstack.requestlog [None req-472dd0be-fa6a-44e4-8757-defd9bdeca2a admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017712 Jul 21 10:39:22.947125 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: [pid: 110329|app: 0|req: 22/45] 10.222.0.48 () {60 vars in 1210 bytes} [Thu Jul 21 10:39:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:39:22.956696 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi [None req-78d67cc3-4d36-416d-88a3-3347230c8056 admin admin] Calling method '>' {{(pid=110330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:39:22.970566 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: INFO nova.api.openstack.requestlog [None req-78d67cc3-4d36-416d-88a3-3347230c8056 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017446 Jul 21 10:39:22.971182 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: [pid: 110330|app: 0|req: 24/46] 10.222.0.48 () {60 vars in 1210 bytes} [Thu Jul 21 10:39:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:39:22.980612 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi [None req-117f3a1c-ec8a-4306-92e0-a6ef0b85c0a9 admin admin] Calling method '>' {{(pid=110329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:39:22.987328 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: INFO nova.api.openstack.wsgi [None req-117f3a1c-ec8a-4306-92e0-a6ef0b85c0a9 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 21 10:39:22.988904 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi [None req-117f3a1c-ec8a-4306-92e0-a6ef0b85c0a9 admin admin] Request method failure captured: Jul 21 10:39:22.988904 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 21 10:39:22.988904 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: Accept: application/json Jul 21 10:39:22.988904 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: Accept-Encoding: gzip, deflate Jul 21 10:39:22.988904 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: Connection: keep-alive Jul 21 10:39:22.988904 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: Content-Length: 0 Jul 21 10:39:22.988904 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: Host: 10.222.0.48 Jul 21 10:39:22.988904 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: Openstack-Api-Version: compute 2.90 Jul 21 10:39:22.988904 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: Openstack-System-Scope: None Jul 21 10:39:22.988904 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: User-Agent: python-novaclient Jul 21 10:39:22.988904 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: X-Auth-Token: gAAAAABi2SzaekA1J7FbqJcxBR8M7lfx4HVeeWnjTwkRuBSPOpSCIZ7klVYNg7EKSVCvlQq52STt-J2UX162-Rfy5N4hV64FdxSYiWMsT2zDIrtXuWPXiu2oGSSCx1GCAfvdUhM84Gmp_wener2LspDn3az_MtbjHnGZ6hSuWvOa7JrUE7A2Y_U Jul 21 10:39:22.988904 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: X-Domain-Id: None Jul 21 10:39:22.988904 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: X-Domain-Name: None Jul 21 10:39:22.988904 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: X-Identity-Status: Confirmed Jul 21 10:39:22.988904 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: X-Is-Admin-Project: True Jul 21 10:39:22.988904 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: X-Openstack-Nova-Api-Version: 2.90 Jul 21 10:39:22.988904 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: X-Project-Domain-Id: default Jul 21 10:39:22.988904 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: X-Project-Domain-Name: Default Jul 21 10:39:22.988904 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: X-Project-Id: 549a3510fe3f48278464436ac5f2a88c Jul 21 10:39:22.988904 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: X-Project-Name: admin Jul 21 10:39:22.988904 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: X-Role: admin,reader,member Jul 21 10:39:22.988904 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: X-Roles: admin,reader,member Jul 21 10:39:22.990322 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/549a3510fe3f48278464436ac5f2a88c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/549a3510fe3f48278464436ac5f2a88c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/549a3510fe3f48278464436ac5f2a88c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_549a3510fe3f48278464436ac5f2a88c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] Jul 21 10:39:22.990322 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: X-Tenant: admin Jul 21 10:39:22.990322 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: X-Tenant-Id: 549a3510fe3f48278464436ac5f2a88c Jul 21 10:39:22.990322 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: X-Tenant-Name: admin Jul 21 10:39:22.990322 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: X-User: admin Jul 21 10:39:22.990322 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: X-User-Domain-Id: default Jul 21 10:39:22.990322 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: X-User-Domain-Name: Default Jul 21 10:39:22.990322 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: X-User-Id: 1db1bf9bea374f37b124738f1edc4d39 Jul 21 10:39:22.990322 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: X-User-Name: admin Jul 21 10:39:22.990322 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: method: > Jul 21 10:39:22.990322 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: exception: Flavor 84 could not be found. Jul 21 10:39:22.990322 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: action_args: {'id': '84'} Jul 21 10:39:22.990322 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: {{(pid=110329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 10:39:22.990322 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:39:22.991326 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 21 10:39:22.991326 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 21 10:39:22.991326 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 21 10:39:22.991326 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 21 10:39:22.991326 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 21 10:39:22.991326 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 21 10:39:22.991326 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 21 10:39:22.991326 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 21 10:39:22.991326 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 21 10:39:22.991326 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 10:39:22.991326 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 21 10:39:22.991326 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 21 10:39:22.991326 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 21 10:39:22.991326 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: ERROR nova.api.openstack.wsgi Jul 21 10:39:22.991326 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:39:22.991326 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: ERROR nova.api.openstack.wsgi Jul 21 10:39:22.991326 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:39:22.991326 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:39:22.991326 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:39:22.992547 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 10:39:22.992547 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 10:39:22.992547 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 10:39:22.992547 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 10:39:22.992547 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 21 10:39:22.992547 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 21 10:39:22.992547 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 21 10:39:22.992547 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: ERROR nova.api.openstack.wsgi Jul 21 10:39:22.992547 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:39:22.992547 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: ERROR nova.api.openstack.wsgi Jul 21 10:39:22.992547 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:39:22.992547 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:39:22.992547 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:39:22.992547 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 10:39:22.992547 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 10:39:22.992547 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 21 10:39:22.992547 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: ERROR nova.api.openstack.wsgi Jul 21 10:39:22.992547 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi [None req-117f3a1c-ec8a-4306-92e0-a6ef0b85c0a9 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110329) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 10:39:22.993799 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: INFO nova.api.openstack.requestlog [None req-117f3a1c-ec8a-4306-92e0-a6ef0b85c0a9 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.013211 Jul 21 10:39:22.993799 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: [pid: 110329|app: 0|req: 23/47] 10.222.0.48 () {60 vars in 1190 bytes} [Thu Jul 21 10:39:22 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 21 10:39:24.048444 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi [None req-78d67cc3-4d36-416d-88a3-3347230c8056 admin admin] Calling method '>' {{(pid=110330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:39:24.049453 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: INFO nova.api.openstack.requestlog [None req-78d67cc3-4d36-416d-88a3-3347230c8056 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001545 Jul 21 10:39:24.049852 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: [pid: 110330|app: 0|req: 25/48] 10.222.0.48 () {56 vars in 1074 bytes} [Thu Jul 21 10:39:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:39:24.613531 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi [None req-8421eb00-a001-4b4a-83e2-ebc445bf4d0e admin admin] Calling method '>' {{(pid=110329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:39:24.619434 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: INFO nova.api.openstack.wsgi [None req-8421eb00-a001-4b4a-83e2-ebc445bf4d0e admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 21 10:39:24.620966 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi [None req-8421eb00-a001-4b4a-83e2-ebc445bf4d0e admin admin] Request method failure captured: Jul 21 10:39:24.620966 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 21 10:39:24.620966 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: Accept: application/json Jul 21 10:39:24.620966 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: Accept-Encoding: gzip, deflate Jul 21 10:39:24.620966 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: Connection: keep-alive Jul 21 10:39:24.620966 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: Content-Length: 0 Jul 21 10:39:24.620966 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: Host: 10.222.0.48 Jul 21 10:39:24.620966 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: Openstack-Api-Version: compute 2.90 Jul 21 10:39:24.620966 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: Openstack-System-Scope: None Jul 21 10:39:24.620966 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: User-Agent: python-novaclient Jul 21 10:39:24.620966 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: X-Auth-Token: gAAAAABi2SzbFpnS-9IIYV3mZOk4Kgh9P545DykzcccOPKnY7LfRJ9x2mt6n118ez3MFc2DY8wuQfn3Fib2KnfXppuc7IedEd-m1wR1G20xg0KeNCcu2KtXxT1n3xBHyFkxKNETyJF6LawTgKF5GAzLHIDznUL5fS8aiHJMfdja0eOUyfOyrBUk Jul 21 10:39:24.620966 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: X-Domain-Id: None Jul 21 10:39:24.620966 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: X-Domain-Name: None Jul 21 10:39:24.620966 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: X-Identity-Status: Confirmed Jul 21 10:39:24.620966 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: X-Is-Admin-Project: True Jul 21 10:39:24.620966 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: X-Openstack-Nova-Api-Version: 2.90 Jul 21 10:39:24.620966 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: X-Project-Domain-Id: default Jul 21 10:39:24.620966 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: X-Project-Domain-Name: Default Jul 21 10:39:24.620966 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: X-Project-Id: 549a3510fe3f48278464436ac5f2a88c Jul 21 10:39:24.620966 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: X-Project-Name: admin Jul 21 10:39:24.620966 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: X-Role: admin,reader,member Jul 21 10:39:24.620966 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: X-Roles: admin,reader,member Jul 21 10:39:24.622453 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/549a3510fe3f48278464436ac5f2a88c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/549a3510fe3f48278464436ac5f2a88c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/549a3510fe3f48278464436ac5f2a88c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_549a3510fe3f48278464436ac5f2a88c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] Jul 21 10:39:24.622453 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: X-Tenant: admin Jul 21 10:39:24.622453 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: X-Tenant-Id: 549a3510fe3f48278464436ac5f2a88c Jul 21 10:39:24.622453 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: X-Tenant-Name: admin Jul 21 10:39:24.622453 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: X-User: admin Jul 21 10:39:24.622453 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: X-User-Domain-Id: default Jul 21 10:39:24.622453 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: X-User-Domain-Name: Default Jul 21 10:39:24.622453 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: X-User-Id: 1db1bf9bea374f37b124738f1edc4d39 Jul 21 10:39:24.622453 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: X-User-Name: admin Jul 21 10:39:24.622453 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: method: > Jul 21 10:39:24.622453 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: exception: Flavor 451 could not be found. Jul 21 10:39:24.622453 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: action_args: {'id': '451'} Jul 21 10:39:24.622453 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: {{(pid=110329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 10:39:24.622453 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:39:24.623544 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 21 10:39:24.623544 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 21 10:39:24.623544 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 21 10:39:24.623544 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 21 10:39:24.623544 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 21 10:39:24.623544 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 21 10:39:24.623544 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 21 10:39:24.623544 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 21 10:39:24.623544 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 21 10:39:24.623544 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 10:39:24.623544 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 21 10:39:24.623544 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 21 10:39:24.623544 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 21 10:39:24.623544 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: ERROR nova.api.openstack.wsgi Jul 21 10:39:24.623544 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:39:24.623544 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: ERROR nova.api.openstack.wsgi Jul 21 10:39:24.623544 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:39:24.623544 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:39:24.623544 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:39:24.625093 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 10:39:24.625093 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 10:39:24.625093 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 10:39:24.625093 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 10:39:24.625093 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 21 10:39:24.625093 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 21 10:39:24.625093 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 21 10:39:24.625093 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: ERROR nova.api.openstack.wsgi Jul 21 10:39:24.625093 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:39:24.625093 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: ERROR nova.api.openstack.wsgi Jul 21 10:39:24.625093 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:39:24.625093 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:39:24.625093 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:39:24.625093 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 10:39:24.625093 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 10:39:24.625093 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 21 10:39:24.625093 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: ERROR nova.api.openstack.wsgi Jul 21 10:39:24.625093 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi [None req-8421eb00-a001-4b4a-83e2-ebc445bf4d0e admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110329) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 10:39:24.626093 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: INFO nova.api.openstack.requestlog [None req-8421eb00-a001-4b4a-83e2-ebc445bf4d0e admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.422666 Jul 21 10:39:24.626093 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: [pid: 110329|app: 0|req: 24/49] 10.222.0.48 () {60 vars in 1193 bytes} [Thu Jul 21 10:39:24 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 424 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 21 10:39:24.633330 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi [None req-2cd8b881-7a7a-47a4-9ea9-ded1c0279179 admin admin] Calling method '>' {{(pid=110330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:39:24.647622 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: INFO nova.api.openstack.requestlog [None req-2cd8b881-7a7a-47a4-9ea9-ded1c0279179 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017813 Jul 21 10:39:24.648185 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: [pid: 110330|app: 0|req: 26/50] 10.222.0.48 () {60 vars in 1210 bytes} [Thu Jul 21 10:39:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:39:24.658273 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi [None req-135cb93f-0885-4e56-80e2-7704dd1977bb admin admin] Calling method '>' {{(pid=110329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:39:24.673845 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: INFO nova.api.openstack.requestlog [None req-135cb93f-0885-4e56-80e2-7704dd1977bb admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019323 Jul 21 10:39:24.674402 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: [pid: 110329|app: 0|req: 25/51] 10.222.0.48 () {60 vars in 1210 bytes} [Thu Jul 21 10:39:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 10:39:24.684104 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi [None req-51e631f0-0c5b-40df-8542-f08b34229b24 admin admin] Calling method '>' {{(pid=110330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:39:24.690300 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: INFO nova.api.openstack.wsgi [None req-51e631f0-0c5b-40df-8542-f08b34229b24 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 21 10:39:24.691828 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi [None req-51e631f0-0c5b-40df-8542-f08b34229b24 admin admin] Request method failure captured: Jul 21 10:39:24.691828 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 21 10:39:24.691828 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: Accept: application/json Jul 21 10:39:24.691828 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: Accept-Encoding: gzip, deflate Jul 21 10:39:24.691828 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: Connection: keep-alive Jul 21 10:39:24.691828 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: Content-Length: 0 Jul 21 10:39:24.691828 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: Host: 10.222.0.48 Jul 21 10:39:24.691828 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: Openstack-Api-Version: compute 2.90 Jul 21 10:39:24.691828 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: Openstack-System-Scope: None Jul 21 10:39:24.691828 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: User-Agent: python-novaclient Jul 21 10:39:24.691828 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: X-Auth-Token: gAAAAABi2SzbFpnS-9IIYV3mZOk4Kgh9P545DykzcccOPKnY7LfRJ9x2mt6n118ez3MFc2DY8wuQfn3Fib2KnfXppuc7IedEd-m1wR1G20xg0KeNCcu2KtXxT1n3xBHyFkxKNETyJF6LawTgKF5GAzLHIDznUL5fS8aiHJMfdja0eOUyfOyrBUk Jul 21 10:39:24.691828 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: X-Domain-Id: None Jul 21 10:39:24.691828 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: X-Domain-Name: None Jul 21 10:39:24.691828 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: X-Identity-Status: Confirmed Jul 21 10:39:24.691828 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: X-Is-Admin-Project: True Jul 21 10:39:24.691828 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: X-Openstack-Nova-Api-Version: 2.90 Jul 21 10:39:24.691828 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: X-Project-Domain-Id: default Jul 21 10:39:24.691828 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: X-Project-Domain-Name: Default Jul 21 10:39:24.691828 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: X-Project-Id: 549a3510fe3f48278464436ac5f2a88c Jul 21 10:39:24.691828 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: X-Project-Name: admin Jul 21 10:39:24.691828 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: X-Role: admin,reader,member Jul 21 10:39:24.691828 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: X-Roles: admin,reader,member Jul 21 10:39:24.693171 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/549a3510fe3f48278464436ac5f2a88c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/549a3510fe3f48278464436ac5f2a88c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/549a3510fe3f48278464436ac5f2a88c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_549a3510fe3f48278464436ac5f2a88c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] Jul 21 10:39:24.693171 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: X-Tenant: admin Jul 21 10:39:24.693171 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: X-Tenant-Id: 549a3510fe3f48278464436ac5f2a88c Jul 21 10:39:24.693171 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: X-Tenant-Name: admin Jul 21 10:39:24.693171 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: X-User: admin Jul 21 10:39:24.693171 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: X-User-Domain-Id: default Jul 21 10:39:24.693171 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: X-User-Domain-Name: Default Jul 21 10:39:24.693171 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: X-User-Id: 1db1bf9bea374f37b124738f1edc4d39 Jul 21 10:39:24.693171 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: X-User-Name: admin Jul 21 10:39:24.693171 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: method: > Jul 21 10:39:24.693171 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: exception: Flavor 451 could not be found. Jul 21 10:39:24.693171 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: action_args: {'id': '451'} Jul 21 10:39:24.693171 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: {{(pid=110330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 10:39:24.693171 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:39:24.694148 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 21 10:39:24.694148 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 21 10:39:24.694148 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 21 10:39:24.694148 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 21 10:39:24.694148 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 21 10:39:24.694148 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 21 10:39:24.694148 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 21 10:39:24.694148 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 21 10:39:24.694148 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 21 10:39:24.694148 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 10:39:24.694148 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 21 10:39:24.694148 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 21 10:39:24.694148 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 21 10:39:24.694148 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: ERROR nova.api.openstack.wsgi Jul 21 10:39:24.694148 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:39:24.694148 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: ERROR nova.api.openstack.wsgi Jul 21 10:39:24.694148 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:39:24.694148 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:39:24.694148 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:39:24.695578 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 10:39:24.695578 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 10:39:24.695578 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 10:39:24.695578 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 10:39:24.695578 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 21 10:39:24.695578 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 21 10:39:24.695578 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 21 10:39:24.695578 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: ERROR nova.api.openstack.wsgi Jul 21 10:39:24.695578 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:39:24.695578 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: ERROR nova.api.openstack.wsgi Jul 21 10:39:24.695578 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:39:24.695578 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:39:24.695578 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:39:24.695578 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 10:39:24.695578 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 10:39:24.695578 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 21 10:39:24.695578 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: ERROR nova.api.openstack.wsgi Jul 21 10:39:24.695578 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi [None req-51e631f0-0c5b-40df-8542-f08b34229b24 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110330) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 10:39:24.696879 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: INFO nova.api.openstack.requestlog [None req-51e631f0-0c5b-40df-8542-f08b34229b24 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012820 Jul 21 10:39:24.696879 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: [pid: 110330|app: 0|req: 27/52] 10.222.0.48 () {60 vars in 1193 bytes} [Thu Jul 21 10:39:24 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 21 10:39:25.710222 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi [None req-135cb93f-0885-4e56-80e2-7704dd1977bb admin admin] Calling method '>' {{(pid=110329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:39:25.711330 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: INFO nova.api.openstack.requestlog [None req-135cb93f-0885-4e56-80e2-7704dd1977bb admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001553 Jul 21 10:39:25.711813 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: [pid: 110329|app: 0|req: 26/53] 10.222.0.48 () {56 vars in 1074 bytes} [Thu Jul 21 10:39:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:39:26.247597 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi [None req-a782b071-bccb-43f4-a3f9-d2c1f29f305c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:39:26.328059 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: INFO nova.api.openstack.requestlog [None req-a782b071-bccb-43f4-a3f9-d2c1f29f305c admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.467405 Jul 21 10:39:26.328602 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: [pid: 110330|app: 0|req: 28/54] 10.222.0.48 () {64 vars in 1235 bytes} [Thu Jul 21 10:39:25 2022] POST /compute/v2.1/flavors => generated 404 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 10:39:27.322519 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi [None req-135cb93f-0885-4e56-80e2-7704dd1977bb admin admin] Calling method '>' {{(pid=110329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:39:27.323540 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: INFO nova.api.openstack.requestlog [None req-135cb93f-0885-4e56-80e2-7704dd1977bb admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Jul 21 10:39:27.323924 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: [pid: 110329|app: 0|req: 27/55] 10.222.0.48 () {56 vars in 1074 bytes} [Thu Jul 21 10:39:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:39:27.846930 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi [None req-bcecda7f-cd06-45ff-b5d0-625728d3ffac admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:39:27.922651 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: INFO nova.api.openstack.requestlog [None req-bcecda7f-cd06-45ff-b5d0-625728d3ffac admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.459601 Jul 21 10:39:27.923205 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: [pid: 110330|app: 0|req: 29/56] 10.222.0.48 () {64 vars in 1235 bytes} [Thu Jul 21 10:39:27 2022] POST /compute/v2.1/flavors => generated 405 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 10:39:28.922411 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi [None req-135cb93f-0885-4e56-80e2-7704dd1977bb admin admin] Calling method '>' {{(pid=110329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:39:28.923456 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: INFO nova.api.openstack.requestlog [None req-135cb93f-0885-4e56-80e2-7704dd1977bb admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001831 Jul 21 10:39:28.924995 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: [pid: 110329|app: 0|req: 28/57] 10.222.0.48 () {56 vars in 1074 bytes} [Thu Jul 21 10:39:28 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:39:29.460556 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi [None req-c6cb5266-c6d9-4799-a8bd-8b14f9df4cd3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:39:29.568026 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: INFO nova.api.openstack.requestlog [None req-c6cb5266-c6d9-4799-a8bd-8b14f9df4cd3 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.504021 Jul 21 10:39:29.568618 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: [pid: 110330|app: 0|req: 30/58] 10.222.0.48 () {64 vars in 1235 bytes} [Thu Jul 21 10:39:29 2022] POST /compute/v2.1/flavors => generated 407 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 10:39:30.563152 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi [None req-135cb93f-0885-4e56-80e2-7704dd1977bb admin admin] Calling method '>' {{(pid=110329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:39:30.564145 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: INFO nova.api.openstack.requestlog [None req-135cb93f-0885-4e56-80e2-7704dd1977bb admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Jul 21 10:39:30.564546 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: [pid: 110329|app: 0|req: 29/59] 10.222.0.48 () {56 vars in 1074 bytes} [Thu Jul 21 10:39:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:39:31.111298 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi [None req-6db00ff8-f997-41d4-9eee-fdfa8ba16812 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:39:31.181239 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: INFO nova.api.openstack.requestlog [None req-6db00ff8-f997-41d4-9eee-fdfa8ba16812 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.474329 Jul 21 10:39:31.181790 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: [pid: 110330|app: 0|req: 31/60] 10.222.0.48 () {64 vars in 1235 bytes} [Thu Jul 21 10:39:30 2022] POST /compute/v2.1/flavors => generated 409 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 10:39:32.177829 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi [None req-135cb93f-0885-4e56-80e2-7704dd1977bb admin admin] Calling method '>' {{(pid=110329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:39:32.178860 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: INFO nova.api.openstack.requestlog [None req-135cb93f-0885-4e56-80e2-7704dd1977bb admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Jul 21 10:39:32.179251 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: [pid: 110329|app: 0|req: 30/61] 10.222.0.48 () {56 vars in 1074 bytes} [Thu Jul 21 10:39:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:39:32.717489 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi [None req-236b8f60-860f-43b5-a614-626e638b79e1 admin admin] Calling method '>' {{(pid=110330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:39:32.738168 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: INFO nova.api.openstack.requestlog [None req-236b8f60-860f-43b5-a614-626e638b79e1 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.418764 Jul 21 10:39:32.738742 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: [pid: 110330|app: 0|req: 32/62] 10.222.0.48 () {60 vars in 1202 bytes} [Thu Jul 21 10:39:32 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:40:26.824696 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi [None req-135cb93f-0885-4e56-80e2-7704dd1977bb admin admin] Calling method '>' {{(pid=110329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:40:26.825990 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: INFO nova.api.openstack.requestlog [None req-135cb93f-0885-4e56-80e2-7704dd1977bb admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002260 Jul 21 10:40:26.826378 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: [pid: 110329|app: 0|req: 31/63] 10.222.0.48 () {54 vars in 930 bytes} [Thu Jul 21 10:40:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:40:26.841838 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG dbcounter [-] [110330] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=110330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:40:27.260249 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi [None req-d44079e0-6d4c-448f-bc1f-a94685c1b974 admin admin] Calling method '>' {{(pid=110330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:40:27.281096 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: INFO nova.api.openstack.requestlog [None req-d44079e0-6d4c-448f-bc1f-a94685c1b974 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.444609 Jul 21 10:40:27.281640 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: [pid: 110330|app: 0|req: 33/64] 10.222.0.48 () {60 vars in 1291 bytes} [Thu Jul 21 10:40:26 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:40:27.304542 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG dbcounter [-] [110329] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=22,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=110329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:40:27.308887 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi [None req-e544e27c-48c3-4421-9ca6-c6380b550990 admin admin] Calling method '>' {{(pid=110329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:40:27.316607 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: INFO nova.api.openstack.requestlog [None req-e544e27c-48c3-4421-9ca6-c6380b550990 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013599 Jul 21 10:40:27.317144 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: [pid: 110329|app: 0|req: 32/65] 10.222.0.48 () {60 vars in 1282 bytes} [Thu Jul 21 10:40:27 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:40:27.330488 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi [None req-90e0ee6c-d64d-451e-9334-37feffeed893 admin admin] Calling method '>' {{(pid=110330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:40:27.338213 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: INFO nova.api.openstack.requestlog [None req-90e0ee6c-d64d-451e-9334-37feffeed893 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011416 Jul 21 10:40:27.338774 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: [pid: 110330|app: 0|req: 34/66] 10.222.0.48 () {60 vars in 1285 bytes} [Thu Jul 21 10:40:27 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:40:27.350661 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi [None req-88cbdb48-f228-4dc3-9fc9-e8c4c893e56c admin admin] Calling method '>' {{(pid=110329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:40:27.359550 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: INFO nova.api.openstack.requestlog [None req-88cbdb48-f228-4dc3-9fc9-e8c4c893e56c admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012820 Jul 21 10:40:27.360098 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: [pid: 110329|app: 0|req: 33/67] 10.222.0.48 () {60 vars in 1285 bytes} [Thu Jul 21 10:40:27 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:40:27.372613 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi [None req-70906f56-2600-4d20-895f-6890083f6e5d admin admin] Calling method '>' {{(pid=110330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:40:27.380408 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: INFO nova.api.openstack.requestlog [None req-70906f56-2600-4d20-895f-6890083f6e5d admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012291 Jul 21 10:40:27.380858 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: [pid: 110330|app: 0|req: 35/68] 10.222.0.48 () {60 vars in 1282 bytes} [Thu Jul 21 10:40:27 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:44:08.995096 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi [None req-88cbdb48-f228-4dc3-9fc9-e8c4c893e56c admin admin] Calling method '>' {{(pid=110329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:44:08.996128 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: INFO nova.api.openstack.requestlog [None req-88cbdb48-f228-4dc3-9fc9-e8c4c893e56c admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001509 Jul 21 10:44:08.996519 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: [pid: 110329|app: 0|req: 34/69] 10.222.0.48 () {56 vars in 1074 bytes} [Thu Jul 21 10:44:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:44:09.145464 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG dbcounter [-] [110330] Writing DB stats nova_api:SELECT=6 {{(pid=110330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:44:09.309672 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi [None req-4630a8f3-8245-4cb0-b60c-06b0485c6fb4 admin admin] Calling method '>' {{(pid=110330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:44:09.310749 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 10:44:09.310749 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: warnings.warn(msg) Jul 21 10:44:09.311947 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG oslo_concurrency.lockutils [None req-4630a8f3-8245-4cb0-b60c-06b0485c6fb4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:44:09.312386 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG oslo_concurrency.lockutils [None req-4630a8f3-8245-4cb0-b60c-06b0485c6fb4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:44:09.313202 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG oslo_concurrency.lockutils [None req-4630a8f3-8245-4cb0-b60c-06b0485c6fb4 admin admin] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:44:09.313628 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG oslo_concurrency.lockutils [None req-4630a8f3-8245-4cb0-b60c-06b0485c6fb4 admin admin] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:44:09.348871 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: INFO nova.api.openstack.requestlog [None req-4630a8f3-8245-4cb0-b60c-06b0485c6fb4 admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.204908 Jul 21 10:44:09.349432 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: [pid: 110330|app: 0|req: 36/70] 10.222.0.48 () {60 vars in 1193 bytes} [Thu Jul 21 10:44:09 2022] GET /compute/v2.1/os-services => generated 791 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 21 10:44:10.191043 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi [None req-88cbdb48-f228-4dc3-9fc9-e8c4c893e56c admin admin] Calling method '>' {{(pid=110329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:44:10.192048 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: INFO nova.api.openstack.requestlog [None req-88cbdb48-f228-4dc3-9fc9-e8c4c893e56c admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Jul 21 10:44:10.192635 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: [pid: 110329|app: 0|req: 35/71] 10.222.0.48 () {56 vars in 1074 bytes} [Thu Jul 21 10:44:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:44:10.395239 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi [None req-e3318d2f-dec1-4978-a1b9-1f70458ae51f admin admin] Calling method '>' {{(pid=110330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:44:10.396411 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 10:44:10.396411 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: warnings.warn(msg) Jul 21 10:44:10.397647 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG oslo_concurrency.lockutils [None req-e3318d2f-dec1-4978-a1b9-1f70458ae51f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:44:10.398021 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG oslo_concurrency.lockutils [None req-e3318d2f-dec1-4978-a1b9-1f70458ae51f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:44:10.398824 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG oslo_concurrency.lockutils [None req-e3318d2f-dec1-4978-a1b9-1f70458ae51f admin admin] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:44:10.399244 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG oslo_concurrency.lockutils [None req-e3318d2f-dec1-4978-a1b9-1f70458ae51f admin admin] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:44:10.419431 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: INFO nova.api.openstack.requestlog [None req-e3318d2f-dec1-4978-a1b9-1f70458ae51f admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.077436 Jul 21 10:44:10.420001 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: [pid: 110330|app: 0|req: 37/72] 10.222.0.48 () {60 vars in 1193 bytes} [Thu Jul 21 10:44:10 2022] GET /compute/v2.1/os-services => generated 791 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 10:44:21.683286 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi [None req-88cbdb48-f228-4dc3-9fc9-e8c4c893e56c admin admin] Calling method '>' {{(pid=110329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:44:21.684828 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: INFO nova.api.openstack.requestlog [None req-88cbdb48-f228-4dc3-9fc9-e8c4c893e56c admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Jul 21 10:44:21.685233 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: [pid: 110329|app: 0|req: 36/73] 10.222.0.48 () {56 vars in 1074 bytes} [Thu Jul 21 10:44:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:44:21.829938 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG dbcounter [-] [110330] Writing DB stats nova_cell0:SELECT=4 {{(pid=110330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:44:21.830698 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG dbcounter [-] [110330] Writing DB stats nova_cell1:SELECT=4 {{(pid=110330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:44:21.831314 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG dbcounter [-] [110330] Writing DB stats nova_api:SELECT=8 {{(pid=110330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:44:21.882678 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi [None req-3fe0bc94-58d6-42a0-adf4-80123b122b0a admin admin] Calling method '>' {{(pid=110330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:44:21.883882 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 10:44:21.883882 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: warnings.warn(msg) Jul 21 10:44:21.885060 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG oslo_concurrency.lockutils [None req-3fe0bc94-58d6-42a0-adf4-80123b122b0a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:44:21.885496 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG oslo_concurrency.lockutils [None req-3fe0bc94-58d6-42a0-adf4-80123b122b0a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:44:21.886415 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG oslo_concurrency.lockutils [None req-3fe0bc94-58d6-42a0-adf4-80123b122b0a admin admin] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:44:21.886874 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG oslo_concurrency.lockutils [None req-3fe0bc94-58d6-42a0-adf4-80123b122b0a admin admin] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:44:21.919366 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: INFO nova.api.openstack.requestlog [None req-3fe0bc94-58d6-42a0-adf4-80123b122b0a admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.087403 Jul 21 10:44:21.919366 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: [pid: 110330|app: 0|req: 38/74] 10.222.0.48 () {60 vars in 1193 bytes} [Thu Jul 21 10:44:21 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:44:22.747707 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: DEBUG nova.api.openstack.wsgi [None req-88cbdb48-f228-4dc3-9fc9-e8c4c893e56c admin admin] Calling method '>' {{(pid=110329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:44:22.748765 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: INFO nova.api.openstack.requestlog [None req-88cbdb48-f228-4dc3-9fc9-e8c4c893e56c admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001808 Jul 21 10:44:22.749242 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: [pid: 110329|app: 0|req: 37/75] 10.222.0.48 () {56 vars in 1074 bytes} [Thu Jul 21 10:44:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:44:22.943513 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG nova.api.openstack.wsgi [None req-45124224-eb4b-4502-84d8-64391db9586e admin admin] Calling method '>' {{(pid=110330) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:44:22.944727 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 10:44:22.944727 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: warnings.warn(msg) Jul 21 10:44:22.945906 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG oslo_concurrency.lockutils [None req-45124224-eb4b-4502-84d8-64391db9586e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:44:22.946346 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG oslo_concurrency.lockutils [None req-45124224-eb4b-4502-84d8-64391db9586e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:44:22.947156 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG oslo_concurrency.lockutils [None req-45124224-eb4b-4502-84d8-64391db9586e admin admin] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:44:22.947586 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: DEBUG oslo_concurrency.lockutils [None req-45124224-eb4b-4502-84d8-64391db9586e admin admin] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110330) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:44:22.970229 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: INFO nova.api.openstack.requestlog [None req-45124224-eb4b-4502-84d8-64391db9586e admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.082566 Jul 21 10:44:22.970829 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: [pid: 110330|app: 0|req: 39/76] 10.222.0.48 () {60 vars in 1193 bytes} [Thu Jul 21 10:44:22 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:45:19.881546 dv-cinder-849800-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 21 10:45:19.882437 dv-cinder-849800-2-iscsi devstack@n-api.service[110328]: Thu Jul 21 10:45:19 2022 - graceful shutdown triggered... Jul 21 10:45:19.882920 dv-cinder-849800-2-iscsi devstack@n-api.service[110329]: Gracefully killing worker 1 (pid: 110329)... Jul 21 10:45:19.883283 dv-cinder-849800-2-iscsi devstack@n-api.service[110330]: Gracefully killing worker 2 (pid: 110330)... Jul 21 10:45:20.883598 dv-cinder-849800-2-iscsi devstack@n-api.service[110328]: worker 1 buried after 1 seconds Jul 21 10:45:20.884089 dv-cinder-849800-2-iscsi devstack@n-api.service[110328]: worker 2 buried after 1 seconds Jul 21 10:45:20.884089 dv-cinder-849800-2-iscsi devstack@n-api.service[110328]: goodbye to uWSGI. Jul 21 10:45:20.885210 dv-cinder-849800-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 21 10:45:20.886660 dv-cinder-849800-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 21 10:45:20.889491 dv-cinder-849800-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 21 10:45:20.899193 dv-cinder-849800-2-iscsi devstack@n-api.service[124852]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 21 10:45:20.901696 dv-cinder-849800-2-iscsi devstack@n-api.service[124852]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 21 10:45:20 2022] *** Jul 21 10:45:20.901856 dv-cinder-849800-2-iscsi devstack@n-api.service[124852]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 21 10:45:20.901987 dv-cinder-849800-2-iscsi devstack@n-api.service[124852]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 21 10:45:20.902112 dv-cinder-849800-2-iscsi devstack@n-api.service[124852]: nodename: dv-cinder-849800-2-iscsi Jul 21 10:45:20.902223 dv-cinder-849800-2-iscsi devstack@n-api.service[124852]: machine: x86_64 Jul 21 10:45:20.902349 dv-cinder-849800-2-iscsi devstack@n-api.service[124852]: clock source: unix Jul 21 10:45:20.902457 dv-cinder-849800-2-iscsi devstack@n-api.service[124852]: pcre jit disabled Jul 21 10:45:20.902649 dv-cinder-849800-2-iscsi devstack@n-api.service[124852]: detected number of CPU cores: 4 Jul 21 10:45:20.902792 dv-cinder-849800-2-iscsi devstack@n-api.service[124852]: current working directory: / Jul 21 10:45:20.902928 dv-cinder-849800-2-iscsi devstack@n-api.service[124852]: detected binary path: /usr/bin/uwsgi-core Jul 21 10:45:20.903046 dv-cinder-849800-2-iscsi devstack@n-api.service[124852]: your processes number limit is 47680 Jul 21 10:45:20.903156 dv-cinder-849800-2-iscsi devstack@n-api.service[124852]: your memory page size is 4096 bytes Jul 21 10:45:20.903273 dv-cinder-849800-2-iscsi devstack@n-api.service[124852]: detected max file descriptor number: 2048 Jul 21 10:45:20.903394 dv-cinder-849800-2-iscsi devstack@n-api.service[124852]: lock engine: pthread robust mutexes Jul 21 10:45:20.903679 dv-cinder-849800-2-iscsi devstack@n-api.service[124852]: thunder lock: enabled Jul 21 10:45:20.903994 dv-cinder-849800-2-iscsi devstack@n-api.service[124852]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 21 10:45:20.904111 dv-cinder-849800-2-iscsi devstack@n-api.service[124852]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 21 10:45:20.948539 dv-cinder-849800-2-iscsi devstack@n-api.service[124852]: Python main interpreter initialized at 0x55ade4aee9c0 Jul 21 10:45:20.948539 dv-cinder-849800-2-iscsi devstack@n-api.service[124852]: python threads support enabled Jul 21 10:45:20.948539 dv-cinder-849800-2-iscsi devstack@n-api.service[124852]: your server socket listen backlog is limited to 100 connections Jul 21 10:45:20.948539 dv-cinder-849800-2-iscsi devstack@n-api.service[124852]: your mercy for graceful operations on workers is 90 seconds Jul 21 10:45:20.948995 dv-cinder-849800-2-iscsi devstack@n-api.service[124852]: mapped 403077 bytes (393 KB) for 2 cores Jul 21 10:45:20.949084 dv-cinder-849800-2-iscsi devstack@n-api.service[124852]: *** Operational MODE: preforking *** Jul 21 10:45:20.949327 dv-cinder-849800-2-iscsi devstack@n-api.service[124852]: *** uWSGI is running in multiple interpreter mode *** Jul 21 10:45:20.949327 dv-cinder-849800-2-iscsi devstack@n-api.service[124852]: spawned uWSGI master process (pid: 124852) Jul 21 10:45:20.949574 dv-cinder-849800-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 21 10:45:20.950155 dv-cinder-849800-2-iscsi devstack@n-api.service[124852]: spawned uWSGI worker 1 (pid: 124867, cores: 1) Jul 21 10:45:20.951759 dv-cinder-849800-2-iscsi devstack@n-api.service[124852]: spawned uWSGI worker 2 (pid: 124868, cores: 1) Jul 21 10:45:20.951759 dv-cinder-849800-2-iscsi devstack@n-api.service[124852]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 21 10:45:21.637218 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 21 10:45:21.669433 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 21 10:45:22.854076 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 10:45:22.854076 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: from cryptography.utils import int_from_bytes Jul 21 10:45:22.854883 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 10:45:22.854883 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: from cryptography.utils import int_from_bytes Jul 21 10:45:22.975855 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 10:45:22.975855 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: from cryptography.utils import int_from_bytes Jul 21 10:45:22.976463 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 10:45:22.976463 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: from cryptography.utils import int_from_bytes Jul 21 10:45:25.207027 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 21 10:45:25.207604 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 21 10:45:25.208636 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 21 10:45:25.208636 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 21 10:45:25.208636 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 21 10:45:25.208864 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.209111 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.209436 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.209760 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.210094 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.210408 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.210779 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.211110 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.211444 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.211712 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.212031 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.212360 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849800-2-iscsi {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.212688 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.212999 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.213317 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.214575 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.214907 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.215244 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.215561 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.216071 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.217393 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.217393 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.217611 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.217891 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.218214 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.218538 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.218898 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.219206 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.219531 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.219867 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.220263 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849800-2-iscsi {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.220587 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.221008 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.221213 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.221624 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.221941 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.222264 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.222601 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.222931 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.223251 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.223575 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.224165 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.224614 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.224830 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.225123 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.225434 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.225747 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.226094 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.226379 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.226755 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.226967 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.227276 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.227599 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.227923 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.228248 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.228501 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.228753 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.229076 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.229468 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.229809 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.230086 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.230393 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.230730 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.231042 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.231351 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.231657 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.231965 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.232289 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.232608 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.232936 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.233248 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.233572 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.233984 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.234238 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.234565 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.234935 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.235243 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.235553 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.235877 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.236197 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.236587 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.236817 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.237131 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.237465 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.237794 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.238101 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.238352 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.238685 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.238993 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.239312 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.239933 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.240257 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.240573 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.240885 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.241245 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.241560 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.241870 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.242183 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.242903 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.242903 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.243277 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.243414 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.243722 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.244050 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.244550 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.245147 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.245455 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.245776 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.246068 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.246397 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.246739 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.247059 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.247386 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.247699 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.248010 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.248497 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.248822 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.249122 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.249608 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.249927 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.250242 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.250578 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.259917 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.259917 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.259917 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.259917 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.259917 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.259917 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.259917 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.259917 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.261122 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.261122 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.261122 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.261122 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.261122 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.261122 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.261122 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.261122 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.261715 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.261715 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.261715 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.261715 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.261715 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.261715 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.261715 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.261715 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.262293 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.262293 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.262293 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.262293 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.262293 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.262293 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.262293 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.262293 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.262847 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.262847 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.262847 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.262847 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.262847 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.263219 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.263383 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.263742 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.264198 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.264392 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.264705 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.265029 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.265345 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.265659 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.265972 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.266297 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.266665 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.266985 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.267314 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.267634 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.267950 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.268263 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.268577 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.268893 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.269262 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.269553 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.269874 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.270191 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.270512 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.270860 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.271172 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.271483 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.271793 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.272099 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.272406 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.272718 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.273022 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.273344 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.273671 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.273981 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.274332 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.274650 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.274974 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.275275 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.275586 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.275893 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.276917 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.277323 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.277580 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.277848 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.278167 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.278476 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.278826 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.279135 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.279445 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.279761 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.280073 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.280384 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.280698 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.281011 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.281337 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.281651 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.281964 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.282300 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.282655 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.282968 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.283296 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.283625 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.283943 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.284250 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.284561 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.284874 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.285203 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.285595 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.285789 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.286101 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.286404 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.288288 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.288288 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.288288 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.288288 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.288288 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.288288 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.289077 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.289235 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.289499 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.289814 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.290187 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.290531 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.290878 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.291209 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.291531 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.291917 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.292240 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.292555 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.292879 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.293182 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.293508 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.293824 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.294149 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.294466 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.294826 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.295142 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.295488 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.295763 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.296085 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.300037 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.300037 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.300037 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.300037 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.300037 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.300037 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.300037 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.300037 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.300684 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.300684 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.300684 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.300684 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.300684 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.300684 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.301233 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.301233 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.301395 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.301642 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.301959 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.302295 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.302660 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.302974 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.303290 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.303616 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.303934 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.304245 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.304564 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.304868 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.305178 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.305503 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.305811 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.306126 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.306436 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.306769 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.307086 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.308235 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.308698 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.309021 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.309401 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.309655 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.309971 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.311775 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.311775 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.311775 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.311775 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.311775 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.312869 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.312869 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.312869 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.312869 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.313877 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.313877 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.313877 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.314610 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.314610 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.314610 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.315221 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.315221 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.315510 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.315796 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.316091 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.316401 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.316713 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.317027 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.317334 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.317642 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.318054 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.318273 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.318605 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.318920 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.319227 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.319540 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.319871 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.320445 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.320779 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.321098 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.321420 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.321742 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.322063 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.322417 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.322754 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.325031 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.325031 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.325031 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.325031 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.325031 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.325482 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.325482 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.325810 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.326116 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.326427 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.326836 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.327144 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.327451 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.329032 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.329032 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.329032 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.329032 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.329032 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.329572 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.329572 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.329861 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.330167 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.330473 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.330871 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.331182 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.331526 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.331857 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.332205 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.332514 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.333110 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.333266 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.333441 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.333745 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.334050 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.334471 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.334711 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.335024 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.335334 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.335643 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.335956 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.336271 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.336571 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.336880 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.337187 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.337507 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.337814 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.338120 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.338427 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.338914 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.339249 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.339631 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.339953 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.340266 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.340586 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.340896 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.341205 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.341514 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.341825 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.342135 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.342441 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.342817 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.343127 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.343434 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.343743 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.344055 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.344362 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.344667 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.344977 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.345303 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.345620 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.345929 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.346240 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.346556 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.346870 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.347173 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.347492 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.347789 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.348088 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.348389 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.348700 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.349272 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.349598 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.349908 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.350215 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.350519 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.350843 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.351193 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.351496 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.351854 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.352160 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.352478 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.353404 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.353404 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.353404 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.355127 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.355565 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.356043 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.357410 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.357410 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.357410 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.357410 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.358693 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.358693 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.358693 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.359200 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.359949 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.360320 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.360645 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.360974 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.361299 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.361622 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.361945 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.362266 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.362605 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.362932 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.363273 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.363753 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.364082 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.364397 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.364715 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.365031 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.365342 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.365677 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.365991 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.366301 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.366644 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.366976 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.367295 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.367632 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.368079 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.368396 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.368711 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.369021 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.369335 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.369674 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.370569 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.370888 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.371197 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.371619 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.371932 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.372250 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.372559 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.372870 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.373176 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.373488 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.373968 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.374283 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.374615 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.374924 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.375253 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.375558 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.375884 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.376305 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.376620 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.376935 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.377354 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.377667 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.377979 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.378304 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.378656 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.378983 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.380800 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.380800 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.380800 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.380800 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.380800 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.381193 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.381267 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.381529 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.382029 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.382363 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.382792 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.383119 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.383542 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.384027 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.384350 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.384678 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.385001 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.385308 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.386199 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.386522 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.386901 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.387285 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.387618 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.387930 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.388279 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.388559 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.388894 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.389164 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.389497 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.389929 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.390174 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.390390 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.390796 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.391049 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.391362 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.391669 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.392184 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.392461 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.392693 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.392925 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.393172 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.393732 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.394198 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.394531 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.394886 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.395318 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.395637 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.395972 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.396301 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.396620 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.396969 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.397328 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.397643 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.397949 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.398262 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.398679 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.398940 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.399252 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.399638 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.399864 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.400220 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.400455 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.400744 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.401129 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.401553 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.401864 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.402202 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.402611 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.402881 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.403112 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.403415 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.403834 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.404076 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.404508 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.404909 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.405221 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.405548 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.405863 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.406179 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.406494 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.406887 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.407249 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.407525 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.407804 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.408113 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.408425 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.408834 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.409167 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.409622 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.409907 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.410233 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.410537 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.410949 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.411266 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.411580 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.411892 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.412205 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.412636 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.412828 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.413160 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.413483 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.413810 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.414146 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.414728 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.420567 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.420567 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.420567 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.420567 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.420567 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.420567 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.420567 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.421582 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.421582 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.421582 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.421582 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.421582 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.421582 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.421582 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.421582 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.423163 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.423163 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.423163 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.423163 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.423163 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.423163 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.423163 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.423163 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.424500 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.424500 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.424500 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.424500 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.424500 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.425284 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.425284 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.425559 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.425700 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.425913 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.426593 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.426916 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.427228 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.427555 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.427868 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.428317 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.428551 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.428862 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.429428 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.429783 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.430242 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.430679 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.431373 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.431701 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.432006 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.433347 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.433624 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.433901 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.434299 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.434610 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.434978 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.435146 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.435600 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.435916 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.436226 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.436541 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.436879 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.437184 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.438178 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.438178 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.438178 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.438721 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.438721 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.439022 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.439449 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.439659 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.439974 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.440433 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.440835 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.441140 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.441372 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.441655 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.441897 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.442207 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.442634 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.442878 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.443161 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.443509 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.443777 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.444098 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.444619 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.444904 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.445319 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.445319 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.446078 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.446320 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 21 10:45:25.446320 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 21 10:45:25.447445 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.447445 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.448540 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 21 10:45:25.448830 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.449028 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 21 10:45:25.449226 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.449394 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 21 10:45:25.449680 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.449836 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.449989 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.450144 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.450289 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.450289 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.450786 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.451070 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.451238 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.451394 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.451539 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.451681 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.451831 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.451982 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.451982 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.452264 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.452415 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.452559 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.452713 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.452856 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.452856 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.453188 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.453334 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.453503 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.453746 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849800-2-iscsi {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.453908 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.454065 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.454209 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.454352 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.454352 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.454891 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.455053 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.455336 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.455489 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.455642 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.455787 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.455929 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.456081 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.456224 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.456367 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.456559 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.456805 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.457051 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.457359 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.457594 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.457839 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.458216 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.458455 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.458762 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.458999 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.459285 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.459499 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.459723 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.460048 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.460293 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.460514 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.460759 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.461265 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.461511 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.461737 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.461983 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.462236 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849800-2-iscsi {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.462475 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.462743 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.462979 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.463391 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.463594 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.463768 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.464022 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.464180 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.464488 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.464647 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.464811 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.465182 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.465474 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.465635 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.465791 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.465937 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.466082 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.466245 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.466397 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.466562 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.466732 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.466886 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.467037 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.467314 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.467540 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.467711 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.467868 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.468021 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.468191 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.468451 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.468607 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.468767 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.468919 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.469064 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.469258 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.469258 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.469258 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.469688 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.469863 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.470252 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.470252 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.470763 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.471060 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.471722 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.471971 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.472225 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.472469 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.472718 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.472974 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.473235 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.473515 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.473737 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.474352 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.474602 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.474846 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.474846 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.475765 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.475997 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.476238 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.476500 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.476758 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.476994 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.477291 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.477529 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.477702 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.477868 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.478027 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.478179 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.478330 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.478657 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.478824 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.478985 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.479194 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.479355 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.479588 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.479780 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.479925 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.480082 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.480369 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.480540 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.480686 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.480831 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.480988 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.481143 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.481294 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.481598 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.481876 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.482032 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.482191 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.482336 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.482480 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.482724 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.482892 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.483044 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.483198 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.483343 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.483486 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.483629 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.483814 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.483964 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.484118 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.484287 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.484287 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.484692 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.484871 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.485033 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.485184 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.485391 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.485653 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.486031 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.486184 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.486184 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.486485 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.486674 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.486828 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.486985 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.487136 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.487307 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.487458 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.487607 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.487756 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.487913 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.488071 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.488236 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.488388 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.488536 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.488794 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.488949 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.489116 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.489282 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.489444 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.489616 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.489768 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.489768 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.489768 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.490217 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.490393 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.490691 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.490850 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.491007 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.491167 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.491319 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.491479 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.491765 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.492076 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.492244 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.492397 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.492555 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.492706 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.492856 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.493005 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.493169 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.493328 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.493497 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.493770 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.493952 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.494105 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.494255 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.494406 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.495287 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.495470 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.497174 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.497417 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.497581 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.497800 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.497965 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.498133 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.498307 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.498307 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.498643 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.498975 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.499150 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.499312 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.499472 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.499625 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.499775 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.499974 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.500147 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.500306 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.500465 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 21 10:45:25.500657 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.500657 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.500657 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.500657 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.500657 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.500657 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.500657 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.500657 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.502359 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.502359 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.502359 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.502359 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.502359 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.502359 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.502359 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.502359 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 10:45:25.503543 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.503543 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.503543 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.503543 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.503543 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.503543 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.503543 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.503543 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.504816 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.504816 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.504816 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.504816 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.504816 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.504816 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.504816 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.504816 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.506216 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.506216 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.506216 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.506216 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.506216 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.506216 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.506216 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.506216 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.507866 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.507866 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.507866 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.507866 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.507866 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.507866 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.507866 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.507866 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.509183 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.509183 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.509183 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.509183 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.509183 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.509183 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.509183 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.509183 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.511512 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.511512 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.511512 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.511512 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.511512 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.511512 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.511512 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.511512 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.512958 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.512958 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.512958 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.512958 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.512958 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.512958 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.512958 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.512958 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.514159 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.514159 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.514159 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.514159 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.514159 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.514159 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.514159 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.514159 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.515493 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.515493 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.515493 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.515493 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.515493 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.515493 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.516402 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.516402 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.516402 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.516985 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.516985 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.517277 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.517444 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.517882 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.518041 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.518359 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.518728 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.519065 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.519477 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.519744 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.519978 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.520299 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.520602 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.520918 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.521222 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.521645 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.521871 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.522107 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.522676 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.522912 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.523127 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.523351 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.523603 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.523929 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.524238 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.524540 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.524842 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.525145 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.525549 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.525806 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.526157 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.527153 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.527479 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.528105 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.528105 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.528593 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.528826 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.529069 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.529325 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.529734 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.530051 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.530301 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.530587 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.530895 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.531183 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.533102 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.533102 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.533102 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.533102 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.533102 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.534020 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.534020 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.534020 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.534463 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.534700 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.535019 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.535335 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.535681 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.536006 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.536273 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.536583 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.536901 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.537209 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.537533 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.537847 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.538301 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.538480 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.538796 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.539129 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.539461 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.539775 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.540084 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.540404 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.540715 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.541025 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.541335 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.541698 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.542756 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.543020 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.543348 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.543663 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.543978 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.544290 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.544608 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.544921 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.545226 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.545531 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.545885 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.546180 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.546492 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.546849 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.547252 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.547475 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.547780 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.548111 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.548407 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.548720 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.549005 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.549308 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.549654 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.549967 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.550268 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.550618 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.550944 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.551253 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.551572 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.551903 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.552185 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.552512 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.552901 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.553129 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.553470 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.553741 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.554049 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.554355 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.554713 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.555027 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.555338 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.555644 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.555964 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.556252 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.556569 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.557155 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.558029 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.559082 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.559316 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.559642 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.560081 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.560305 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.560637 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.560992 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.561301 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.561613 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.561921 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.562229 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.562595 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.562880 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.563308 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.563583 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.564015 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.564283 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.564537 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.564786 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.565053 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.565353 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.565582 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.565840 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.566247 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.566490 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.566786 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.567094 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.567399 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.567744 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.568014 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.568375 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.568753 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.569207 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.569616 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.569616 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.570062 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.570438 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.570706 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.570949 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.571179 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.571413 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.571701 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.572001 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.572685 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.572685 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.574363 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.574677 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.574911 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.575139 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.575370 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.575661 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.575973 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.576382 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.576631 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.576882 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.577177 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.577482 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.577794 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.578082 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.578457 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.578732 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.579138 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.579578 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.579578 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.580218 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.580218 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.580856 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.580856 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.581343 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.581590 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.581837 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.582075 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.582312 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.582609 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.582888 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.583206 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.583508 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.583822 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.584266 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.584594 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.584756 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.585007 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.585308 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.585611 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.586380 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.586380 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.586867 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.586867 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.587176 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.587533 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.587722 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.588117 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.588339 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.589186 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.589849 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.590284 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.590505 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.590817 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.591315 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.591554 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.591794 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.592021 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.592304 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.592612 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.592928 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.593227 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.593531 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.593898 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.594180 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.594680 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.595077 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.595077 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.595536 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.595771 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.595994 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.596292 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.596599 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.596979 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.597223 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.597527 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.597790 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.598113 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.598408 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.599114 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.599522 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.600120 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.600120 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.600739 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.600739 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.601070 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.601070 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.601640 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.601805 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.602055 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.602490 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.602962 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.603277 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.603589 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.603895 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.604337 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.605278 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.605607 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.605933 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.606245 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.606689 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.607010 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.607326 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.607637 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.607945 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.608250 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.608559 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.608882 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.609185 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.609489 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.609790 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.610114 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.610416 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.610759 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.611174 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.611487 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.611795 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.612209 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.612520 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.612831 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.613154 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.613474 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.613797 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.614101 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.614419 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.614754 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.615078 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.615401 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.615711 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.616028 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.616331 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.616658 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.616975 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.617290 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.617607 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.618022 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.618345 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.619211 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.619211 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.619506 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.619671 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.620584 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.621553 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.621871 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.622240 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.623849 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.623849 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.623849 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.623849 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.633798 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.633798 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.633798 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.633798 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.633798 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.633798 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.633798 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.633798 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.634409 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.634409 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.634409 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.634409 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.634409 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.634409 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.634409 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.634409 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.634990 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.634990 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.634990 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.634990 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.634990 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.634990 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.634990 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.634990 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.636207 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.636207 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.636207 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.636207 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.636207 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.636207 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.636207 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.636207 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.636799 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.636799 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.636974 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.637270 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.637585 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.638006 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.638404 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.638757 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.639077 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.639390 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.639803 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.640157 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.640463 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.640802 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.641128 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.641453 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.641784 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.642115 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.642422 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.642769 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.643089 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.643407 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.643724 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.644041 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.644384 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.644674 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.645135 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.645452 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.645779 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.646102 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.646697 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.647030 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.647346 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.647666 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.647971 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.648284 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.648595 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.648907 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.649218 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.649531 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.649842 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.650172 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.650493 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.650908 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.652426 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.652783 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.653114 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.653436 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.653759 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.654126 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.654445 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.654799 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.655123 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.655398 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO dbcounter [None req-161f334c-f7f4-4282-8868-e6cc2a9a5713 None None] Registered counter for database nova_api Jul 21 10:45:25.655571 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.656016 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.656169 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.656358 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.656676 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.656990 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.657305 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.657618 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.657935 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.658248 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.658596 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.661921 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.661921 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.661921 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.661921 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.661921 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.661921 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.661921 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.661921 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.662500 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.662500 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.662500 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.662855 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.663069 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.663374 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.663680 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.663991 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.664301 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.664606 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.664927 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.665237 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.665543 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.665862 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.666176 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.667455 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.667455 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.668891 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.668891 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.669084 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.669333 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.669642 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.669968 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.670277 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.670679 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.671817 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.671817 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.671817 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.671817 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.672123 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.672439 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.672764 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.673062 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.673545 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.673886 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.674192 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.677034 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.677034 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.677034 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.677034 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.677034 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.677034 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.677034 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.677034 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.677620 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.677620 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.677620 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.677838 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.678062 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.678348 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_db.sqlalchemy.engines [None req-161f334c-f7f4-4282-8868-e6cc2a9a5713 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124868) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 10:45:25.678464 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.678832 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.679191 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.679506 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.679928 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.680321 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.680581 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.680875 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.681355 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.681499 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.681852 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.682686 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.683457 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.683801 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.684131 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.684478 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.684813 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.685125 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.685435 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.685743 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.685934 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writer thread running {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 10:45:25.686070 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.686388 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.686732 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.690579 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.690579 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.690579 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.690579 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.690579 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.690579 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.690579 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.690579 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.691461 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.691461 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.691461 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.691461 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.691461 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.691461 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.691461 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.691983 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.691983 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.692253 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.692519 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.692831 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.693140 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.693455 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.693783 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.694099 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.694403 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.694861 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.695177 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.695496 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.695815 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.696125 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.696450 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.696923 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.697244 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.697562 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.698499 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.699478 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.699823 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.700153 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.702072 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.702072 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.702072 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.702072 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.702072 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.702072 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.702697 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.702785 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.703079 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.703389 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.703694 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.704005 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.704308 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.704614 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.704923 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.705228 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.705533 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.705836 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.706141 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.706444 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.706772 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.707082 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.707390 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.707694 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.707996 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.708382 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.708698 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.709040 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.709369 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.709684 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.710006 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.710318 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.710660 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.710974 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.711293 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.711611 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.711931 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.712239 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.712569 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.712878 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.713186 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.713554 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.714979 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.715306 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.715623 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.715954 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.716281 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.716590 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.716916 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.717234 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.717560 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.717970 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.718181 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.718509 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.719234 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.719234 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.719437 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.719748 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.720057 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.720374 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.720685 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.720994 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.721310 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.721624 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.721949 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.722278 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.722599 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.722927 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.723383 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.724255 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.724255 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.724952 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.724952 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.725502 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.725502 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.725988 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 10:45:25.725988 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 21 10:45:25.749258 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.context [None req-161f334c-f7f4-4282-8868-e6cc2a9a5713 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),67214de0-1644-4a2c-ab6c-aaec113708cb(cell1) {{(pid=124868) load_cells /opt/stack/nova/nova/context.py:464}} Jul 21 10:45:25.753746 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-161f334c-f7f4-4282-8868-e6cc2a9a5713 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:45:25.755840 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-161f334c-f7f4-4282-8868-e6cc2a9a5713 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:45:25.756673 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-161f334c-f7f4-4282-8868-e6cc2a9a5713 None None] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:45:25.759054 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-161f334c-f7f4-4282-8868-e6cc2a9a5713 None None] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:45:25.762399 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO dbcounter [None req-161f334c-f7f4-4282-8868-e6cc2a9a5713 None None] Registered counter for database nova_cell0 Jul 21 10:45:25.767169 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO dbcounter [None req-161f334c-f7f4-4282-8868-e6cc2a9a5713 None None] Registered counter for database nova_cell1 Jul 21 10:45:25.776135 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_db.sqlalchemy.engines [None req-161f334c-f7f4-4282-8868-e6cc2a9a5713 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124868) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 10:45:25.777957 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_db.sqlalchemy.engines [None req-161f334c-f7f4-4282-8868-e6cc2a9a5713 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124868) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 10:45:25.785875 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writer thread running {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 10:45:25.787283 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writer thread running {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 10:45:25.886135 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO dbcounter [None req-8aa1a74b-6c3b-4847-abaf-812352a72ed1 None None] Registered counter for database nova_api Jul 21 10:45:25.907459 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_db.sqlalchemy.engines [None req-8aa1a74b-6c3b-4847-abaf-812352a72ed1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124867) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 10:45:25.914524 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writer thread running {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 10:45:25.946132 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO dbcounter [None req-161f334c-f7f4-4282-8868-e6cc2a9a5713 None None] Registered counter for database nova_cell0 Jul 21 10:45:25.953502 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_db.sqlalchemy.engines [None req-161f334c-f7f4-4282-8868-e6cc2a9a5713 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124868) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 10:45:25.958105 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writer thread running {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 10:45:25.975338 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.context [None req-8aa1a74b-6c3b-4847-abaf-812352a72ed1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),67214de0-1644-4a2c-ab6c-aaec113708cb(cell1) {{(pid=124867) load_cells /opt/stack/nova/nova/context.py:464}} Jul 21 10:45:25.980270 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8aa1a74b-6c3b-4847-abaf-812352a72ed1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:45:25.981894 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8aa1a74b-6c3b-4847-abaf-812352a72ed1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:45:25.982774 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8aa1a74b-6c3b-4847-abaf-812352a72ed1 None None] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:45:25.984752 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8aa1a74b-6c3b-4847-abaf-812352a72ed1 None None] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:45:25.986779 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO dbcounter [None req-8aa1a74b-6c3b-4847-abaf-812352a72ed1 None None] Registered counter for database nova_cell0 Jul 21 10:45:25.990880 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO dbcounter [None req-8aa1a74b-6c3b-4847-abaf-812352a72ed1 None None] Registered counter for database nova_cell1 Jul 21 10:45:25.998132 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_db.sqlalchemy.engines [None req-8aa1a74b-6c3b-4847-abaf-812352a72ed1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124867) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 10:45:26.001682 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_db.sqlalchemy.engines [None req-8aa1a74b-6c3b-4847-abaf-812352a72ed1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124867) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 10:45:26.003807 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writer thread running {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 10:45:26.153657 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writer thread running {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 10:45:26.163323 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO dbcounter [None req-8aa1a74b-6c3b-4847-abaf-812352a72ed1 None None] Registered counter for database nova_cell0 Jul 21 10:45:26.171539 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_db.sqlalchemy.engines [None req-8aa1a74b-6c3b-4847-abaf-812352a72ed1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124867) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 10:45:26.176255 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writer thread running {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 10:45:26.281643 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: WARNING keystonemiddleware.auth_token [None req-161f334c-f7f4-4282-8868-e6cc2a9a5713 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 21 10:45:26.289735 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: WARNING keystonemiddleware.auth_token [None req-161f334c-f7f4-4282-8868-e6cc2a9a5713 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 21 10:45:26.501854 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: WARNING keystonemiddleware.auth_token [None req-8aa1a74b-6c3b-4847-abaf-812352a72ed1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 21 10:45:26.511116 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: WARNING keystonemiddleware.auth_token [None req-8aa1a74b-6c3b-4847-abaf-812352a72ed1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 21 10:45:26.637468 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: WARNING keystonemiddleware.auth_token [None req-161f334c-f7f4-4282-8868-e6cc2a9a5713 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 21 10:45:26.643593 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: WARNING keystonemiddleware.auth_token [None req-161f334c-f7f4-4282-8868-e6cc2a9a5713 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 21 10:45:26.650318 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ade4aee9c0 pid: 124868 (default app) Jul 21 10:45:26.873747 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: WARNING keystonemiddleware.auth_token [None req-8aa1a74b-6c3b-4847-abaf-812352a72ed1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 21 10:45:26.879651 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: WARNING keystonemiddleware.auth_token [None req-8aa1a74b-6c3b-4847-abaf-812352a72ed1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 21 10:45:26.886422 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ade4aee9c0 pid: 124867 (default app) Jul 21 10:46:10.082587 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_api:SELECT=3 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:46:10.084118 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell1:SELECT=3 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:46:10.085315 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell0:SELECT=3 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:46:10.089458 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell0:SELECT=3 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:46:10.357360 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_api:SELECT=3 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:46:10.358367 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell0:SELECT=3 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:46:10.360095 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell1:SELECT=3 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:46:10.368456 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell0:SELECT=3 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:46:11.430754 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-d476cdec-f2b2-4197-a542-6cf5e2f8f65d tempest-VolumesNegativeTest-329890446 tempest-VolumesNegativeTest-329890446-project] Action: 'create', calling method: .version_select at 0x7f7964abdca0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-649296906", "metadata": {"Type": "work"}}} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:46:11.457807 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-d476cdec-f2b2-4197-a542-6cf5e2f8f65d tempest-VolumesNegativeTest-329890446 tempest-VolumesNegativeTest-329890446-project] Request method failure captured: Jul 21 10:46:11.457807 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 21 10:46:11.457807 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Accept: application/json Jul 21 10:46:11.457807 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Accept-Encoding: identity Jul 21 10:46:11.457807 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Connection: close Jul 21 10:46:11.457807 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Content-Length: 121 Jul 21 10:46:11.457807 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Content-Type: application/json Jul 21 10:46:11.457807 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Host: 10.222.0.48 Jul 21 10:46:11.457807 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Openstack-System-Scope: None Jul 21 10:46:11.457807 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: User-Agent: python-urllib3/1.26.9 Jul 21 10:46:11.457807 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Auth-Token: gAAAAABi2S5xpYyruKkzhE3ZW2yG_PVVQj17rX61sIzONFgcj3rgAmT25D10r_5sxbdYF3z8N8-WDYvdTn46n69DNn3vULH9uMvJlsXEDV17cWTk36jyDWoy4fs-RrLFfsoqa1g7xkvFzxI96uBT51JqfzApa6fC2Dr6oGuEECa40tNxrFxOrN4 Jul 21 10:46:11.457807 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Domain-Id: None Jul 21 10:46:11.457807 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Domain-Name: None Jul 21 10:46:11.457807 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Identity-Status: Confirmed Jul 21 10:46:11.457807 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Is-Admin-Project: True Jul 21 10:46:11.457807 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Domain-Id: default Jul 21 10:46:11.457807 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Domain-Name: Default Jul 21 10:46:11.457807 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Id: dfdeaccd863e4b6482f4e54c710b664b Jul 21 10:46:11.457807 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Name: tempest-VolumesNegativeTest-329890446 Jul 21 10:46:11.457807 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Role: reader,member Jul 21 10:46:11.457807 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Roles: reader,member Jul 21 10:46:11.459411 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/dfdeaccd863e4b6482f4e54c710b664b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/dfdeaccd863e4b6482f4e54c710b664b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/dfdeaccd863e4b6482f4e54c710b664b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_dfdeaccd863e4b6482f4e54c710b664b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] Jul 21 10:46:11.459411 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Tenant: tempest-VolumesNegativeTest-329890446 Jul 21 10:46:11.459411 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Tenant-Id: dfdeaccd863e4b6482f4e54c710b664b Jul 21 10:46:11.459411 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Tenant-Name: tempest-VolumesNegativeTest-329890446 Jul 21 10:46:11.459411 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User: tempest-VolumesNegativeTest-329890446-project Jul 21 10:46:11.459411 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Domain-Id: default Jul 21 10:46:11.459411 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Domain-Name: Default Jul 21 10:46:11.459411 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Id: 7d16bd5326394f7aa5ff1a0a4704ebe4 Jul 21 10:46:11.459411 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Name: tempest-VolumesNegativeTest-329890446-project Jul 21 10:46:11.459411 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Jul 21 10:46:11.459411 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-649296906", "metadata": {"Type": "work"}}} Jul 21 10:46:11.459411 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: method: Jul 21 10:46:11.459411 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 21 10:46:11.460558 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-649296906', 'metadata': {'Type': 'work'}}}} Jul 21 10:46:11.460558 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 10:46:11.460558 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:46:11.460558 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 21 10:46:11.460558 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 21 10:46:11.460558 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 21 10:46:11.460558 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise error Jul 21 10:46:11.460558 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 21 10:46:11.460558 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:46:11.460558 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 21 10:46:11.460558 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 21 10:46:11.460558 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:46:11.460558 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 21 10:46:11.460558 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi '#$%' Jul 21 10:46:11.460558 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:46:11.460558 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:46:11.460558 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:46:11.460558 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:46:11.460558 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:46:11.460558 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:46:11.460558 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 10:46:11.460558 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 10:46:11.463716 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 10:46:11.463716 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 10:46:11.463716 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 10:46:11.463716 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 10:46:11.463716 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 21 10:46:11.463716 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 21 10:46:11.463716 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 21 10:46:11.463716 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 21 10:46:11.463716 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 21 10:46:11.463716 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 21 10:46:11.463716 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 21 10:46:11.463716 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:46:11.463716 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:46:11.463716 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:46:11.463716 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:46:11.463716 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:46:11.463716 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:46:11.463716 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 21 10:46:11.463716 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 21 10:46:11.464973 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 21 10:46:11.464973 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:46:11.470942 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-d476cdec-f2b2-4197-a542-6cf5e2f8f65d tempest-VolumesNegativeTest-329890446 tempest-VolumesNegativeTest-329890446-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 10:46:11.474917 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-d476cdec-f2b2-4197-a542-6cf5e2f8f65d tempest-VolumesNegativeTest-329890446 tempest-VolumesNegativeTest-329890446-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.410317 Jul 21 10:46:11.475942 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 1/1] 10.222.0.48 () {60 vars in 1155 bytes} [Thu Jul 21 10:46:10 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1413 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 21 10:46:11.494824 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-9f43712b-6860-4269-b5f4-6cd9540dc87d tempest-VolumesNegativeTest-329890446 tempest-VolumesNegativeTest-329890446-project] Action: 'create', calling method: .version_select at 0x7f79649a1f70>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-185224023", "metadata": {"Type": "work"}}} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:46:11.510282 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-9f43712b-6860-4269-b5f4-6cd9540dc87d tempest-VolumesNegativeTest-329890446 tempest-VolumesNegativeTest-329890446-project] Request method failure captured: Jul 21 10:46:11.510282 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 21 10:46:11.510282 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Accept: application/json Jul 21 10:46:11.510282 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Accept-Encoding: identity Jul 21 10:46:11.510282 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Connection: close Jul 21 10:46:11.510282 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Content-Length: 119 Jul 21 10:46:11.510282 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Content-Type: application/json Jul 21 10:46:11.510282 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Host: 10.222.0.48 Jul 21 10:46:11.510282 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Openstack-System-Scope: None Jul 21 10:46:11.510282 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: User-Agent: python-urllib3/1.26.9 Jul 21 10:46:11.510282 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Auth-Token: gAAAAABi2S5xpYyruKkzhE3ZW2yG_PVVQj17rX61sIzONFgcj3rgAmT25D10r_5sxbdYF3z8N8-WDYvdTn46n69DNn3vULH9uMvJlsXEDV17cWTk36jyDWoy4fs-RrLFfsoqa1g7xkvFzxI96uBT51JqfzApa6fC2Dr6oGuEECa40tNxrFxOrN4 Jul 21 10:46:11.510282 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Domain-Id: None Jul 21 10:46:11.510282 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Domain-Name: None Jul 21 10:46:11.510282 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Identity-Status: Confirmed Jul 21 10:46:11.510282 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Is-Admin-Project: True Jul 21 10:46:11.510282 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Domain-Id: default Jul 21 10:46:11.510282 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Domain-Name: Default Jul 21 10:46:11.510282 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Id: dfdeaccd863e4b6482f4e54c710b664b Jul 21 10:46:11.510282 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Name: tempest-VolumesNegativeTest-329890446 Jul 21 10:46:11.510282 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Role: reader,member Jul 21 10:46:11.510282 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Roles: reader,member Jul 21 10:46:11.511657 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/dfdeaccd863e4b6482f4e54c710b664b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/dfdeaccd863e4b6482f4e54c710b664b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/dfdeaccd863e4b6482f4e54c710b664b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_dfdeaccd863e4b6482f4e54c710b664b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] Jul 21 10:46:11.511657 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Tenant: tempest-VolumesNegativeTest-329890446 Jul 21 10:46:11.511657 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Tenant-Id: dfdeaccd863e4b6482f4e54c710b664b Jul 21 10:46:11.511657 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Tenant-Name: tempest-VolumesNegativeTest-329890446 Jul 21 10:46:11.511657 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User: tempest-VolumesNegativeTest-329890446-project Jul 21 10:46:11.511657 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Domain-Id: default Jul 21 10:46:11.511657 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Domain-Name: Default Jul 21 10:46:11.511657 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Id: 7d16bd5326394f7aa5ff1a0a4704ebe4 Jul 21 10:46:11.511657 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Name: tempest-VolumesNegativeTest-329890446-project Jul 21 10:46:11.511657 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Jul 21 10:46:11.511657 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-185224023", "metadata": {"Type": "work"}}} Jul 21 10:46:11.511657 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: method: Jul 21 10:46:11.511657 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 21 10:46:11.512444 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-185224023', 'metadata': {'Type': 'work'}}}} Jul 21 10:46:11.512444 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 10:46:11.512444 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:46:11.512444 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 21 10:46:11.512444 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 21 10:46:11.512444 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 21 10:46:11.512444 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise error Jul 21 10:46:11.512444 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 21 10:46:11.512444 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:46:11.512444 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 21 10:46:11.512444 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 21 10:46:11.512444 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:46:11.512444 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 21 10:46:11.512444 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi '0' Jul 21 10:46:11.512444 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:46:11.512444 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:46:11.512444 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:46:11.512444 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:46:11.512444 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:46:11.512444 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:46:11.512444 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 10:46:11.512444 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 10:46:11.513897 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 10:46:11.513897 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 10:46:11.513897 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 10:46:11.513897 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 10:46:11.513897 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 21 10:46:11.513897 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 21 10:46:11.513897 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 21 10:46:11.513897 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 21 10:46:11.513897 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 21 10:46:11.513897 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 21 10:46:11.513897 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 21 10:46:11.513897 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:46:11.513897 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:46:11.513897 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:46:11.513897 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:46:11.513897 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:46:11.513897 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:46:11.513897 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 21 10:46:11.513897 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 21 10:46:11.515069 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 21 10:46:11.515069 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:46:11.515069 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-9f43712b-6860-4269-b5f4-6cd9540dc87d tempest-VolumesNegativeTest-329890446 tempest-VolumesNegativeTest-329890446-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 10:46:11.538969 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-9f43712b-6860-4269-b5f4-6cd9540dc87d tempest-VolumesNegativeTest-329890446 tempest-VolumesNegativeTest-329890446-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.045953 Jul 21 10:46:11.542243 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 2/2] 10.222.0.48 () {60 vars in 1155 bytes} [Thu Jul 21 10:46:11 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 56 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 21 10:46:11.589203 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-914609fb-84c3-485c-aab7-200fdb01139c tempest-VolumesNegativeTest-329890446 tempest-VolumesNegativeTest-329890446-project] Action: 'create', calling method: .version_select at 0x7f79649a10d0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1243385056", "metadata": {"Type": "work"}}} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:46:11.599825 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-914609fb-84c3-485c-aab7-200fdb01139c tempest-VolumesNegativeTest-329890446 tempest-VolumesNegativeTest-329890446-project] Request method failure captured: Jul 21 10:46:11.599825 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 21 10:46:11.599825 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Accept: application/json Jul 21 10:46:11.599825 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Accept-Encoding: identity Jul 21 10:46:11.599825 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Connection: close Jul 21 10:46:11.599825 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Content-Length: 119 Jul 21 10:46:11.599825 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Content-Type: application/json Jul 21 10:46:11.599825 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Host: 10.222.0.48 Jul 21 10:46:11.599825 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Openstack-System-Scope: None Jul 21 10:46:11.599825 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: User-Agent: python-urllib3/1.26.9 Jul 21 10:46:11.599825 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Auth-Token: gAAAAABi2S5xpYyruKkzhE3ZW2yG_PVVQj17rX61sIzONFgcj3rgAmT25D10r_5sxbdYF3z8N8-WDYvdTn46n69DNn3vULH9uMvJlsXEDV17cWTk36jyDWoy4fs-RrLFfsoqa1g7xkvFzxI96uBT51JqfzApa6fC2Dr6oGuEECa40tNxrFxOrN4 Jul 21 10:46:11.599825 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Domain-Id: None Jul 21 10:46:11.599825 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Domain-Name: None Jul 21 10:46:11.599825 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Identity-Status: Confirmed Jul 21 10:46:11.599825 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Is-Admin-Project: True Jul 21 10:46:11.599825 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Domain-Id: default Jul 21 10:46:11.599825 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Domain-Name: Default Jul 21 10:46:11.599825 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Id: dfdeaccd863e4b6482f4e54c710b664b Jul 21 10:46:11.599825 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Name: tempest-VolumesNegativeTest-329890446 Jul 21 10:46:11.599825 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Role: reader,member Jul 21 10:46:11.599825 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Roles: reader,member Jul 21 10:46:11.601157 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/dfdeaccd863e4b6482f4e54c710b664b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/dfdeaccd863e4b6482f4e54c710b664b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/dfdeaccd863e4b6482f4e54c710b664b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_dfdeaccd863e4b6482f4e54c710b664b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] Jul 21 10:46:11.601157 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Tenant: tempest-VolumesNegativeTest-329890446 Jul 21 10:46:11.601157 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Tenant-Id: dfdeaccd863e4b6482f4e54c710b664b Jul 21 10:46:11.601157 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Tenant-Name: tempest-VolumesNegativeTest-329890446 Jul 21 10:46:11.601157 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User: tempest-VolumesNegativeTest-329890446-project Jul 21 10:46:11.601157 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Domain-Id: default Jul 21 10:46:11.601157 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Domain-Name: Default Jul 21 10:46:11.601157 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Id: 7d16bd5326394f7aa5ff1a0a4704ebe4 Jul 21 10:46:11.601157 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Name: tempest-VolumesNegativeTest-329890446-project Jul 21 10:46:11.601157 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Jul 21 10:46:11.601157 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1243385056", "metadata": {"Type": "work"}}} Jul 21 10:46:11.601157 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: method: Jul 21 10:46:11.601157 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 21 10:46:11.601904 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1243385056', 'metadata': {'Type': 'work'}}}} Jul 21 10:46:11.601904 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 10:46:11.601904 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:46:11.601904 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 21 10:46:11.601904 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 21 10:46:11.601904 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 21 10:46:11.601904 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise error Jul 21 10:46:11.601904 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 21 10:46:11.601904 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:46:11.601904 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 21 10:46:11.601904 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 21 10:46:11.601904 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:46:11.601904 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 21 10:46:11.601904 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi '' Jul 21 10:46:11.601904 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:46:11.601904 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:46:11.601904 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:46:11.601904 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:46:11.601904 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:46:11.601904 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:46:11.601904 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 10:46:11.601904 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 10:46:11.603193 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 10:46:11.603193 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 10:46:11.603193 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 10:46:11.603193 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 10:46:11.603193 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 21 10:46:11.603193 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 21 10:46:11.603193 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 21 10:46:11.603193 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 21 10:46:11.603193 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 21 10:46:11.603193 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 21 10:46:11.603193 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 21 10:46:11.603193 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:46:11.603193 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:46:11.603193 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:46:11.603193 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:46:11.603193 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:46:11.603193 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:46:11.603193 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 21 10:46:11.603193 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 21 10:46:11.604610 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 21 10:46:11.604610 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:46:11.607148 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-914609fb-84c3-485c-aab7-200fdb01139c tempest-VolumesNegativeTest-329890446 tempest-VolumesNegativeTest-329890446-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 10:46:11.608052 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-914609fb-84c3-485c-aab7-200fdb01139c tempest-VolumesNegativeTest-329890446 tempest-VolumesNegativeTest-329890446-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.054424 Jul 21 10:46:11.613240 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 3/3] 10.222.0.48 () {60 vars in 1155 bytes} [Thu Jul 21 10:46:11 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 65 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 21 10:46:11.630725 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-ffd18cba-0ef7-405a-8d71-af2c67863908 tempest-VolumesNegativeTest-329890446 tempest-VolumesNegativeTest-329890446-project] Calling method '.version_select at 0x7f796497ac10>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:46:11.850082 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-50586d1e-0a9b-40a3-a647-1c898e665234 tempest-VolumesSnapshotsTestJSON-544723011 tempest-VolumesSnapshotsTestJSON-544723011-project] Action: 'create', calling method: .version_select at 0x7f7964a4eca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1074822903"}} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:46:12.458652 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.wsgi [None req-ffd18cba-0ef7-405a-8d71-af2c67863908 tempest-VolumesNegativeTest-329890446 tempest-VolumesNegativeTest-329890446-project] HTTP exception thrown: Volume tempest-invalid-277756133 could not be found. Jul 21 10:46:12.463794 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-ffd18cba-0ef7-405a-8d71-af2c67863908 tempest-VolumesNegativeTest-329890446 tempest-VolumesNegativeTest-329890446-project] Request method failure captured: Jul 21 10:46:12.463794 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-277756133 HTTP/1.1 Jul 21 10:46:12.463794 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Accept: application/json Jul 21 10:46:12.463794 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Accept-Encoding: identity Jul 21 10:46:12.463794 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Connection: close Jul 21 10:46:12.463794 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Content-Length: 0 Jul 21 10:46:12.463794 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Content-Type: application/json Jul 21 10:46:12.463794 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Host: 10.222.0.48 Jul 21 10:46:12.463794 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Openstack-System-Scope: None Jul 21 10:46:12.463794 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: User-Agent: python-urllib3/1.26.9 Jul 21 10:46:12.463794 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Auth-Token: gAAAAABi2S5xpYyruKkzhE3ZW2yG_PVVQj17rX61sIzONFgcj3rgAmT25D10r_5sxbdYF3z8N8-WDYvdTn46n69DNn3vULH9uMvJlsXEDV17cWTk36jyDWoy4fs-RrLFfsoqa1g7xkvFzxI96uBT51JqfzApa6fC2Dr6oGuEECa40tNxrFxOrN4 Jul 21 10:46:12.463794 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Domain-Id: None Jul 21 10:46:12.463794 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Domain-Name: None Jul 21 10:46:12.463794 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Identity-Status: Confirmed Jul 21 10:46:12.463794 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Is-Admin-Project: True Jul 21 10:46:12.463794 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Domain-Id: default Jul 21 10:46:12.463794 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Domain-Name: Default Jul 21 10:46:12.463794 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Id: dfdeaccd863e4b6482f4e54c710b664b Jul 21 10:46:12.463794 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Name: tempest-VolumesNegativeTest-329890446 Jul 21 10:46:12.463794 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Role: reader,member Jul 21 10:46:12.463794 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Roles: reader,member Jul 21 10:46:12.469167 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/dfdeaccd863e4b6482f4e54c710b664b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/dfdeaccd863e4b6482f4e54c710b664b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/dfdeaccd863e4b6482f4e54c710b664b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_dfdeaccd863e4b6482f4e54c710b664b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] Jul 21 10:46:12.469167 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Tenant: tempest-VolumesNegativeTest-329890446 Jul 21 10:46:12.469167 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Tenant-Id: dfdeaccd863e4b6482f4e54c710b664b Jul 21 10:46:12.469167 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Tenant-Name: tempest-VolumesNegativeTest-329890446 Jul 21 10:46:12.469167 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User: tempest-VolumesNegativeTest-329890446-project Jul 21 10:46:12.469167 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Domain-Id: default Jul 21 10:46:12.469167 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Domain-Name: Default Jul 21 10:46:12.469167 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Id: 7d16bd5326394f7aa5ff1a0a4704ebe4 Jul 21 10:46:12.469167 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Name: tempest-VolumesNegativeTest-329890446-project Jul 21 10:46:12.469167 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: method: Jul 21 10:46:12.469167 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: exception: Volume tempest-invalid-277756133 could not be found. Jul 21 10:46:12.469167 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: action_args: {'id': 'tempest-invalid-277756133'} Jul 21 10:46:12.469167 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 10:46:12.470415 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:46:12.470415 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 10:46:12.470415 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 10:46:12.470415 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 21 10:46:12.470415 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 21 10:46:12.470415 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 21 10:46:12.470415 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 21 10:46:12.470415 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 21 10:46:12.470415 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 21 10:46:12.470415 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 21 10:46:12.470415 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 21 10:46:12.470415 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 10:46:12.470415 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 10:46:12.470415 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 10:46:12.470415 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 10:46:12.470415 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-277756133 could not be found. (HTTP 404) (Request-ID: req-7fdd7fd1-3866-4dba-aa83-fd3c6364fa78) Jul 21 10:46:12.470415 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:46:12.470415 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:46:12.470415 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:46:12.471968 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:46:12.471968 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 21 10:46:12.471968 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 21 10:46:12.471968 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 10:46:12.471968 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 10:46:12.471968 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 21 10:46:12.471968 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 21 10:46:12.471968 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 21 10:46:12.471968 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 21 10:46:12.471968 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 10:46:12.471968 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 10:46:12.471968 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 21 10:46:12.471968 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 21 10:46:12.471968 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 21 10:46:12.471968 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 21 10:46:12.471968 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 21 10:46:12.471968 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 21 10:46:12.471968 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 21 10:46:12.471968 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 21 10:46:12.473683 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 10:46:12.473683 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 10:46:12.473683 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 10:46:12.473683 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 10:46:12.473683 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-277756133 could not be found. Jul 21 10:46:12.473683 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:46:12.473683 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:46:12.473683 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:46:12.473683 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:46:12.473683 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:46:12.473683 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:46:12.473683 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 10:46:12.473683 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 10:46:12.473683 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 10:46:12.473683 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 10:46:12.473683 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 10:46:12.473683 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 10:46:12.473683 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 21 10:46:12.473683 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 10:46:12.473683 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-277756133 could not be found. Jul 21 10:46:12.475154 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:46:12.475154 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:46:12.475154 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:46:12.475154 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:46:12.475154 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:46:12.475154 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:46:12.475154 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 10:46:12.475154 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 10:46:12.475154 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-277756133 could not be found. Jul 21 10:46:12.475154 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:46:12.475154 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-ffd18cba-0ef7-405a-8d71-af2c67863908 tempest-VolumesNegativeTest-329890446 tempest-VolumesNegativeTest-329890446-project] Returning 404 to user: Volume tempest-invalid-277756133 could not be found. {{(pid=124868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 10:46:12.475154 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-ffd18cba-0ef7-405a-8d71-af2c67863908 tempest-VolumesNegativeTest-329890446 tempest-VolumesNegativeTest-329890446-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/tempest-invalid-277756133" status: 404 len: 98 microversion: 2.1 time: 0.846534 Jul 21 10:46:12.475154 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 4/4] 10.222.0.48 () {58 vars in 1214 bytes} [Thu Jul 21 10:46:11 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-277756133 => generated 98 bytes in 848 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 21 10:46:12.483157 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-da030f63-18e8-495b-ae5f-c3a034ad3e57 tempest-VolumesNegativeTest-329890446 tempest-VolumesNegativeTest-329890446-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.010851 Jul 21 10:46:12.488802 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 5/5] 10.222.0.48 () {58 vars in 1139 bytes} [Thu Jul 21 10:46:12 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 17 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 21 10:46:12.496528 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-3de927d2-aba6-485f-aa6e-a00fa1c51a5e tempest-VolumesNegativeTest-329890446 tempest-VolumesNegativeTest-329890446-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006598 Jul 21 10:46:12.497666 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 6/6] 10.222.0.48 () {58 vars in 1136 bytes} [Thu Jul 21 10:46:12 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 21 10:46:12.510722 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-dc10d7ba-5fb3-4878-9aae-956b4c4e10a9 tempest-VolumesNegativeTest-329890446 tempest-VolumesNegativeTest-329890446-project] Calling method '.version_select at 0x7f79648b0040>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:46:12.896186 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.wsgi [None req-dc10d7ba-5fb3-4878-9aae-956b4c4e10a9 tempest-VolumesNegativeTest-329890446 tempest-VolumesNegativeTest-329890446-project] HTTP exception thrown: Volume 992c6c8a-8adf-4c22-9aee-8c20260e5604 could not be found. Jul 21 10:46:12.896186 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-dc10d7ba-5fb3-4878-9aae-956b4c4e10a9 tempest-VolumesNegativeTest-329890446 tempest-VolumesNegativeTest-329890446-project] Request method failure captured: Jul 21 10:46:12.896186 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: request: DELETE /compute/v2.1/os-volumes/992c6c8a-8adf-4c22-9aee-8c20260e5604 HTTP/1.1 Jul 21 10:46:12.896186 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Accept: application/json Jul 21 10:46:12.896186 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Accept-Encoding: identity Jul 21 10:46:12.896186 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Connection: close Jul 21 10:46:12.896186 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Content-Length: 0 Jul 21 10:46:12.896186 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Content-Type: application/json Jul 21 10:46:12.896186 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Host: 10.222.0.48 Jul 21 10:46:12.896186 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Openstack-System-Scope: None Jul 21 10:46:12.896186 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: User-Agent: python-urllib3/1.26.9 Jul 21 10:46:12.896186 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Auth-Token: gAAAAABi2S5xpYyruKkzhE3ZW2yG_PVVQj17rX61sIzONFgcj3rgAmT25D10r_5sxbdYF3z8N8-WDYvdTn46n69DNn3vULH9uMvJlsXEDV17cWTk36jyDWoy4fs-RrLFfsoqa1g7xkvFzxI96uBT51JqfzApa6fC2Dr6oGuEECa40tNxrFxOrN4 Jul 21 10:46:12.896186 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Domain-Id: None Jul 21 10:46:12.896186 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Domain-Name: None Jul 21 10:46:12.896186 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Identity-Status: Confirmed Jul 21 10:46:12.896186 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Is-Admin-Project: True Jul 21 10:46:12.896186 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Domain-Id: default Jul 21 10:46:12.896186 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Domain-Name: Default Jul 21 10:46:12.896186 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Id: dfdeaccd863e4b6482f4e54c710b664b Jul 21 10:46:12.896186 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Name: tempest-VolumesNegativeTest-329890446 Jul 21 10:46:12.896186 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Role: reader,member Jul 21 10:46:12.896186 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Roles: reader,member Jul 21 10:46:12.901466 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/dfdeaccd863e4b6482f4e54c710b664b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/dfdeaccd863e4b6482f4e54c710b664b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/dfdeaccd863e4b6482f4e54c710b664b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_dfdeaccd863e4b6482f4e54c710b664b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] Jul 21 10:46:12.901466 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Tenant: tempest-VolumesNegativeTest-329890446 Jul 21 10:46:12.901466 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Tenant-Id: dfdeaccd863e4b6482f4e54c710b664b Jul 21 10:46:12.901466 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Tenant-Name: tempest-VolumesNegativeTest-329890446 Jul 21 10:46:12.901466 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User: tempest-VolumesNegativeTest-329890446-project Jul 21 10:46:12.901466 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Domain-Id: default Jul 21 10:46:12.901466 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Domain-Name: Default Jul 21 10:46:12.901466 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Id: 7d16bd5326394f7aa5ff1a0a4704ebe4 Jul 21 10:46:12.901466 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Name: tempest-VolumesNegativeTest-329890446-project Jul 21 10:46:12.901466 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: method: Jul 21 10:46:12.901466 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: exception: Volume 992c6c8a-8adf-4c22-9aee-8c20260e5604 could not be found. Jul 21 10:46:12.901466 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: action_args: {'id': '992c6c8a-8adf-4c22-9aee-8c20260e5604'} Jul 21 10:46:12.901466 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 10:46:12.904024 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:46:12.904024 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 10:46:12.904024 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 10:46:12.904024 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 21 10:46:12.904024 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 21 10:46:12.904024 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 21 10:46:12.904024 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 21 10:46:12.904024 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 21 10:46:12.904024 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 21 10:46:12.904024 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 21 10:46:12.904024 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 21 10:46:12.904024 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 10:46:12.904024 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 10:46:12.904024 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 10:46:12.904024 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 10:46:12.904024 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 992c6c8a-8adf-4c22-9aee-8c20260e5604 could not be found. (HTTP 404) (Request-ID: req-c0831d67-8650-4378-bd88-7a6bc8764445) Jul 21 10:46:12.904024 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:46:12.904024 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:46:12.904024 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:46:12.905781 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:46:12.905781 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 21 10:46:12.905781 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 21 10:46:12.905781 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 10:46:12.905781 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 10:46:12.905781 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 21 10:46:12.905781 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 21 10:46:12.905781 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 21 10:46:12.905781 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 21 10:46:12.905781 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 10:46:12.905781 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 10:46:12.905781 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 21 10:46:12.905781 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 21 10:46:12.905781 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 21 10:46:12.905781 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 21 10:46:12.905781 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 21 10:46:12.905781 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 21 10:46:12.905781 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 21 10:46:12.905781 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 21 10:46:12.907863 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 10:46:12.907863 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 10:46:12.907863 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 10:46:12.907863 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 10:46:12.907863 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 992c6c8a-8adf-4c22-9aee-8c20260e5604 could not be found. Jul 21 10:46:12.907863 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:46:12.907863 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:46:12.907863 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:46:12.907863 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:46:12.907863 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:46:12.907863 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:46:12.907863 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 10:46:12.907863 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 10:46:12.907863 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 10:46:12.907863 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 10:46:12.907863 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 10:46:12.907863 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 10:46:12.907863 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 21 10:46:12.907863 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 10:46:12.909188 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 992c6c8a-8adf-4c22-9aee-8c20260e5604 could not be found. Jul 21 10:46:12.909188 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:46:12.909188 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:46:12.909188 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:46:12.909188 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:46:12.909188 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:46:12.909188 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:46:12.909188 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 10:46:12.909188 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 10:46:12.909188 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 992c6c8a-8adf-4c22-9aee-8c20260e5604 could not be found. Jul 21 10:46:12.909188 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:46:12.909188 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-dc10d7ba-5fb3-4878-9aae-956b4c4e10a9 tempest-VolumesNegativeTest-329890446 tempest-VolumesNegativeTest-329890446-project] Returning 404 to user: Volume 992c6c8a-8adf-4c22-9aee-8c20260e5604 could not be found. {{(pid=124868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 10:46:12.909188 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-dc10d7ba-5fb3-4878-9aae-956b4c4e10a9 tempest-VolumesNegativeTest-329890446 tempest-VolumesNegativeTest-329890446-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/992c6c8a-8adf-4c22-9aee-8c20260e5604" status: 404 len: 109 microversion: 2.1 time: 0.280406 Jul 21 10:46:12.909188 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 7/7] 10.222.0.48 () {58 vars in 1247 bytes} [Thu Jul 21 10:46:12 2022] DELETE /compute/v2.1/os-volumes/992c6c8a-8adf-4c22-9aee-8c20260e5604 => generated 109 bytes in 282 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 10:46:12.912159 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-15441c26-6495-4565-b809-7d076247cf4c tempest-VolumesNegativeTest-329890446 tempest-VolumesNegativeTest-329890446-project] Calling method '.version_select at 0x7f79648b03a0>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:46:13.250931 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.wsgi [None req-15441c26-6495-4565-b809-7d076247cf4c tempest-VolumesNegativeTest-329890446 tempest-VolumesNegativeTest-329890446-project] HTTP exception thrown: Volume bcd07f8a-229a-4911-8ae9-b2f18f7b9c53 could not be found. Jul 21 10:46:13.252869 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-15441c26-6495-4565-b809-7d076247cf4c tempest-VolumesNegativeTest-329890446 tempest-VolumesNegativeTest-329890446-project] Request method failure captured: Jul 21 10:46:13.252869 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: request: GET /compute/v2.1/os-volumes/bcd07f8a-229a-4911-8ae9-b2f18f7b9c53 HTTP/1.1 Jul 21 10:46:13.252869 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Accept: application/json Jul 21 10:46:13.252869 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Accept-Encoding: identity Jul 21 10:46:13.252869 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Connection: close Jul 21 10:46:13.252869 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Content-Length: 0 Jul 21 10:46:13.252869 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Content-Type: application/json Jul 21 10:46:13.252869 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Host: 10.222.0.48 Jul 21 10:46:13.252869 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Openstack-System-Scope: None Jul 21 10:46:13.252869 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: User-Agent: python-urllib3/1.26.9 Jul 21 10:46:13.252869 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Auth-Token: gAAAAABi2S5xpYyruKkzhE3ZW2yG_PVVQj17rX61sIzONFgcj3rgAmT25D10r_5sxbdYF3z8N8-WDYvdTn46n69DNn3vULH9uMvJlsXEDV17cWTk36jyDWoy4fs-RrLFfsoqa1g7xkvFzxI96uBT51JqfzApa6fC2Dr6oGuEECa40tNxrFxOrN4 Jul 21 10:46:13.252869 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Domain-Id: None Jul 21 10:46:13.252869 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Domain-Name: None Jul 21 10:46:13.252869 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Identity-Status: Confirmed Jul 21 10:46:13.252869 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Is-Admin-Project: True Jul 21 10:46:13.252869 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Domain-Id: default Jul 21 10:46:13.252869 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Domain-Name: Default Jul 21 10:46:13.252869 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Id: dfdeaccd863e4b6482f4e54c710b664b Jul 21 10:46:13.252869 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Name: tempest-VolumesNegativeTest-329890446 Jul 21 10:46:13.252869 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Role: reader,member Jul 21 10:46:13.252869 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Roles: reader,member Jul 21 10:46:13.254016 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/dfdeaccd863e4b6482f4e54c710b664b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/dfdeaccd863e4b6482f4e54c710b664b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/dfdeaccd863e4b6482f4e54c710b664b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_dfdeaccd863e4b6482f4e54c710b664b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] Jul 21 10:46:13.254016 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Tenant: tempest-VolumesNegativeTest-329890446 Jul 21 10:46:13.254016 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Tenant-Id: dfdeaccd863e4b6482f4e54c710b664b Jul 21 10:46:13.254016 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Tenant-Name: tempest-VolumesNegativeTest-329890446 Jul 21 10:46:13.254016 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User: tempest-VolumesNegativeTest-329890446-project Jul 21 10:46:13.254016 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Domain-Id: default Jul 21 10:46:13.254016 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Domain-Name: Default Jul 21 10:46:13.254016 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Id: 7d16bd5326394f7aa5ff1a0a4704ebe4 Jul 21 10:46:13.254016 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Name: tempest-VolumesNegativeTest-329890446-project Jul 21 10:46:13.254016 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: method: Jul 21 10:46:13.254016 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: exception: Volume bcd07f8a-229a-4911-8ae9-b2f18f7b9c53 could not be found. Jul 21 10:46:13.254016 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: action_args: {'id': 'bcd07f8a-229a-4911-8ae9-b2f18f7b9c53'} Jul 21 10:46:13.254016 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 10:46:13.254689 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:46:13.254689 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 10:46:13.254689 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 10:46:13.254689 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 21 10:46:13.254689 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 21 10:46:13.254689 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 21 10:46:13.254689 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 21 10:46:13.254689 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 10:46:13.254689 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 10:46:13.254689 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 10:46:13.254689 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 10:46:13.254689 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 10:46:13.254689 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 10:46:13.254689 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 10:46:13.254689 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 10:46:13.254689 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume bcd07f8a-229a-4911-8ae9-b2f18f7b9c53 could not be found. (HTTP 404) (Request-ID: req-706b8a69-f93f-444b-b62d-2c3d3b723db1) Jul 21 10:46:13.254689 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:46:13.254689 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:46:13.254689 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:46:13.255828 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:46:13.255828 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 21 10:46:13.255828 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 21 10:46:13.255828 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 10:46:13.255828 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 10:46:13.255828 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 21 10:46:13.255828 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 21 10:46:13.255828 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 21 10:46:13.255828 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 21 10:46:13.255828 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 10:46:13.255828 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 10:46:13.255828 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 21 10:46:13.255828 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 21 10:46:13.255828 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 21 10:46:13.255828 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 21 10:46:13.255828 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 10:46:13.255828 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 10:46:13.255828 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 10:46:13.255828 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 10:46:13.256908 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 10:46:13.256908 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 10:46:13.256908 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 10:46:13.256908 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 10:46:13.256908 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume bcd07f8a-229a-4911-8ae9-b2f18f7b9c53 could not be found. Jul 21 10:46:13.256908 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:46:13.256908 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:46:13.256908 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:46:13.256908 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:46:13.256908 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:46:13.256908 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:46:13.256908 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 10:46:13.256908 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 10:46:13.256908 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 10:46:13.256908 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 10:46:13.256908 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 10:46:13.256908 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 10:46:13.256908 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 21 10:46:13.256908 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 10:46:13.258387 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume bcd07f8a-229a-4911-8ae9-b2f18f7b9c53 could not be found. Jul 21 10:46:13.258387 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:46:13.258387 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:46:13.258387 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:46:13.258387 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:46:13.258387 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:46:13.258387 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:46:13.258387 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 10:46:13.258387 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 10:46:13.258387 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume bcd07f8a-229a-4911-8ae9-b2f18f7b9c53 could not be found. Jul 21 10:46:13.258387 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:46:13.258387 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-15441c26-6495-4565-b809-7d076247cf4c tempest-VolumesNegativeTest-329890446 tempest-VolumesNegativeTest-329890446-project] Returning 404 to user: Volume bcd07f8a-229a-4911-8ae9-b2f18f7b9c53 could not be found. {{(pid=124868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 10:46:13.258387 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-15441c26-6495-4565-b809-7d076247cf4c tempest-VolumesNegativeTest-329890446 tempest-VolumesNegativeTest-329890446-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/bcd07f8a-229a-4911-8ae9-b2f18f7b9c53" status: 404 len: 109 microversion: 2.1 time: 0.461182 Jul 21 10:46:13.258387 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 8/8] 10.222.0.48 () {58 vars in 1244 bytes} [Thu Jul 21 10:46:12 2022] GET /compute/v2.1/os-volumes/bcd07f8a-229a-4911-8ae9-b2f18f7b9c53 => generated 109 bytes in 464 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 21 10:46:14.566377 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-50586d1e-0a9b-40a3-a647-1c898e665234 tempest-VolumesSnapshotsTestJSON-544723011 tempest-VolumesSnapshotsTestJSON-544723011-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 4.215417 Jul 21 10:46:14.567607 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 1/9] 10.222.0.48 () {60 vars in 1154 bytes} [Thu Jul 21 10:46:10 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 4224 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 21 10:46:14.583638 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-50ba25fb-c42d-4b28-8ea7-a13a1a0e8097 tempest-VolumesSnapshotsTestJSON-544723011 tempest-VolumesSnapshotsTestJSON-544723011-project] Calling method '.version_select at 0x7f7964896a60>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:46:14.776768 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-50ba25fb-c42d-4b28-8ea7-a13a1a0e8097 tempest-VolumesSnapshotsTestJSON-544723011 tempest-VolumesSnapshotsTestJSON-544723011-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/13acb49d-51d9-426a-a951-20b5a1b75d91" status: 200 len: 345 microversion: 2.1 time: 0.196306 Jul 21 10:46:14.777820 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 9/10] 10.222.0.48 () {58 vars in 1244 bytes} [Thu Jul 21 10:46:14 2022] GET /compute/v2.1/os-volumes/13acb49d-51d9-426a-a951-20b5a1b75d91 => generated 345 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:46:15.795898 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-e9898816-69ae-4d2b-83f7-b24afcc3c696 tempest-VolumesSnapshotsTestJSON-544723011 tempest-VolumesSnapshotsTestJSON-544723011-project] Calling method '.version_select at 0x7f796491aaf0>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:46:15.929991 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-e9898816-69ae-4d2b-83f7-b24afcc3c696 tempest-VolumesSnapshotsTestJSON-544723011 tempest-VolumesSnapshotsTestJSON-544723011-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/13acb49d-51d9-426a-a951-20b5a1b75d91" status: 200 len: 345 microversion: 2.1 time: 0.142221 Jul 21 10:46:15.931190 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 2/11] 10.222.0.48 () {58 vars in 1244 bytes} [Thu Jul 21 10:46:15 2022] GET /compute/v2.1/os-volumes/13acb49d-51d9-426a-a951-20b5a1b75d91 => generated 345 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:46:16.944287 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-86a841ac-aab2-44ba-b033-2a91a3a79e38 tempest-VolumesSnapshotsTestJSON-544723011 tempest-VolumesSnapshotsTestJSON-544723011-project] Calling method '.version_select at 0x7f79648b0160>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:46:17.108399 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-86a841ac-aab2-44ba-b033-2a91a3a79e38 tempest-VolumesSnapshotsTestJSON-544723011 tempest-VolumesSnapshotsTestJSON-544723011-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/13acb49d-51d9-426a-a951-20b5a1b75d91" status: 200 len: 346 microversion: 2.1 time: 0.168305 Jul 21 10:46:17.112952 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 10/12] 10.222.0.48 () {58 vars in 1244 bytes} [Thu Jul 21 10:46:16 2022] GET /compute/v2.1/os-volumes/13acb49d-51d9-426a-a951-20b5a1b75d91 => generated 346 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:46:17.122228 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-1156567e-d8fc-48c7-bc0c-ef9d29702f7b tempest-VolumesSnapshotsTestJSON-544723011 tempest-VolumesSnapshotsTestJSON-544723011-project] Action: 'create', calling method: .version_select at 0x7f796491adc0>, body: {"snapshot": {"volume_id": "13acb49d-51d9-426a-a951-20b5a1b75d91", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-362725828"}} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:46:18.117873 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-1156567e-d8fc-48c7-bc0c-ef9d29702f7b tempest-VolumesSnapshotsTestJSON-544723011 tempest-VolumesSnapshotsTestJSON-544723011-project] 10.222.0.48 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 1.000876 Jul 21 10:46:18.118454 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 3/13] 10.222.0.48 () {60 vars in 1161 bytes} [Thu Jul 21 10:46:17 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:46:18.130770 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-2895adc4-4781-47dd-ad64-a43042e16b47 tempest-VolumesSnapshotsTestJSON-544723011 tempest-VolumesSnapshotsTestJSON-544723011-project] Calling method '.version_select at 0x7f796484a160>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:46:18.252964 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-2895adc4-4781-47dd-ad64-a43042e16b47 tempest-VolumesSnapshotsTestJSON-544723011 tempest-VolumesSnapshotsTestJSON-544723011-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/382266a1-bb29-4d73-b0f6-4642b5b8d26b" status: 200 len: 286 microversion: 2.1 time: 0.127398 Jul 21 10:46:18.254242 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 11/14] 10.222.0.48 () {58 vars in 1250 bytes} [Thu Jul 21 10:46:18 2022] GET /compute/v2.1/os-snapshots/382266a1-bb29-4d73-b0f6-4642b5b8d26b => generated 286 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 10:46:18.264291 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-70b8723f-c0a2-4a07-858d-3d80afff38ed tempest-VolumesSnapshotsTestJSON-544723011 tempest-VolumesSnapshotsTestJSON-544723011-project] Calling method '.version_select at 0x7f796492c700>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:46:18.337195 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-70b8723f-c0a2-4a07-858d-3d80afff38ed tempest-VolumesSnapshotsTestJSON-544723011 tempest-VolumesSnapshotsTestJSON-544723011-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.077344 Jul 21 10:46:18.338627 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 4/15] 10.222.0.48 () {58 vars in 1139 bytes} [Thu Jul 21 10:46:18 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:46:18.350097 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-ab5c9c28-0b39-4947-8434-0dfa41baa8ca tempest-VolumesSnapshotsTestJSON-544723011 tempest-VolumesSnapshotsTestJSON-544723011-project] Calling method '.version_select at 0x7f796484a8b0>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:46:18.406648 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-ab5c9c28-0b39-4947-8434-0dfa41baa8ca tempest-VolumesSnapshotsTestJSON-544723011 tempest-VolumesSnapshotsTestJSON-544723011-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/382266a1-bb29-4d73-b0f6-4642b5b8d26b" status: 200 len: 286 microversion: 2.1 time: 0.061844 Jul 21 10:46:18.411900 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 12/16] 10.222.0.48 () {58 vars in 1250 bytes} [Thu Jul 21 10:46:18 2022] GET /compute/v2.1/os-snapshots/382266a1-bb29-4d73-b0f6-4642b5b8d26b => generated 286 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:46:19.427167 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-b7135cdc-2a4c-4d80-b1e2-36b36b7801b1 tempest-VolumesSnapshotsTestJSON-544723011 tempest-VolumesSnapshotsTestJSON-544723011-project] Calling method '.version_select at 0x7f7964935430>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:46:19.512403 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-b7135cdc-2a4c-4d80-b1e2-36b36b7801b1 tempest-VolumesSnapshotsTestJSON-544723011 tempest-VolumesSnapshotsTestJSON-544723011-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/382266a1-bb29-4d73-b0f6-4642b5b8d26b" status: 200 len: 286 microversion: 2.1 time: 0.097032 Jul 21 10:46:19.515544 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 5/17] 10.222.0.48 () {58 vars in 1250 bytes} [Thu Jul 21 10:46:19 2022] GET /compute/v2.1/os-snapshots/382266a1-bb29-4d73-b0f6-4642b5b8d26b => generated 286 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:46:20.525005 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-c17894df-37a9-40f4-8334-96118e60f4bb tempest-VolumesSnapshotsTestJSON-544723011 tempest-VolumesSnapshotsTestJSON-544723011-project] Calling method '.version_select at 0x7f7964896f70>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:46:20.585148 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-c17894df-37a9-40f4-8334-96118e60f4bb tempest-VolumesSnapshotsTestJSON-544723011 tempest-VolumesSnapshotsTestJSON-544723011-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/382266a1-bb29-4d73-b0f6-4642b5b8d26b" status: 200 len: 286 microversion: 2.1 time: 0.060382 Jul 21 10:46:20.585804 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 13/18] 10.222.0.48 () {58 vars in 1250 bytes} [Thu Jul 21 10:46:20 2022] GET /compute/v2.1/os-snapshots/382266a1-bb29-4d73-b0f6-4642b5b8d26b => generated 286 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:46:21.597983 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-846ed5a8-816a-47cc-b9a2-4ef671c866ab tempest-VolumesSnapshotsTestJSON-544723011 tempest-VolumesSnapshotsTestJSON-544723011-project] Calling method '.version_select at 0x7f796491ab80>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:46:21.703488 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-846ed5a8-816a-47cc-b9a2-4ef671c866ab tempest-VolumesSnapshotsTestJSON-544723011 tempest-VolumesSnapshotsTestJSON-544723011-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/382266a1-bb29-4d73-b0f6-4642b5b8d26b" status: 200 len: 286 microversion: 2.1 time: 0.109879 Jul 21 10:46:21.711116 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 6/19] 10.222.0.48 () {58 vars in 1250 bytes} [Thu Jul 21 10:46:21 2022] GET /compute/v2.1/os-snapshots/382266a1-bb29-4d73-b0f6-4642b5b8d26b => generated 286 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:46:22.719239 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-ce890856-7bd7-4946-8edf-db65be035e4f tempest-VolumesSnapshotsTestJSON-544723011 tempest-VolumesSnapshotsTestJSON-544723011-project] Calling method '.version_select at 0x7f79648b0c10>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:46:22.796163 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-ce890856-7bd7-4946-8edf-db65be035e4f tempest-VolumesSnapshotsTestJSON-544723011 tempest-VolumesSnapshotsTestJSON-544723011-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/382266a1-bb29-4d73-b0f6-4642b5b8d26b" status: 200 len: 287 microversion: 2.1 time: 0.080668 Jul 21 10:46:22.802623 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 14/20] 10.222.0.48 () {58 vars in 1250 bytes} [Thu Jul 21 10:46:22 2022] GET /compute/v2.1/os-snapshots/382266a1-bb29-4d73-b0f6-4642b5b8d26b => generated 287 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:46:22.808729 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-cb52d8e8-8398-46dc-bee9-eba9ecfd2e05 tempest-VolumesSnapshotsTestJSON-544723011 tempest-VolumesSnapshotsTestJSON-544723011-project] Calling method '.version_select at 0x7f79649355e0>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:46:23.081147 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-cb52d8e8-8398-46dc-bee9-eba9ecfd2e05 tempest-VolumesSnapshotsTestJSON-544723011 tempest-VolumesSnapshotsTestJSON-544723011-project] 10.222.0.48 "DELETE /compute/v2.1/os-snapshots/382266a1-bb29-4d73-b0f6-4642b5b8d26b" status: 202 len: 0 microversion: 2.1 time: 0.271266 Jul 21 10:46:23.081147 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 7/21] 10.222.0.48 () {58 vars in 1253 bytes} [Thu Jul 21 10:46:22 2022] DELETE /compute/v2.1/os-snapshots/382266a1-bb29-4d73-b0f6-4642b5b8d26b => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 10:46:23.088690 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-cebaecb2-b7e8-48b6-b09f-3219d427fe81 tempest-VolumesSnapshotsTestJSON-544723011 tempest-VolumesSnapshotsTestJSON-544723011-project] Calling method '.version_select at 0x7f79648b0160>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:46:23.140175 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-cebaecb2-b7e8-48b6-b09f-3219d427fe81 tempest-VolumesSnapshotsTestJSON-544723011 tempest-VolumesSnapshotsTestJSON-544723011-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/382266a1-bb29-4d73-b0f6-4642b5b8d26b" status: 200 len: 286 microversion: 2.1 time: 0.056180 Jul 21 10:46:23.144920 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 15/22] 10.222.0.48 () {58 vars in 1250 bytes} [Thu Jul 21 10:46:23 2022] GET /compute/v2.1/os-snapshots/382266a1-bb29-4d73-b0f6-4642b5b8d26b => generated 286 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:46:24.152977 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-2ecbe370-cd38-4005-b113-d797effffb24 tempest-VolumesSnapshotsTestJSON-544723011 tempest-VolumesSnapshotsTestJSON-544723011-project] Calling method '.version_select at 0x7f7964935a60>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:46:24.195797 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.wsgi [None req-2ecbe370-cd38-4005-b113-d797effffb24 tempest-VolumesSnapshotsTestJSON-544723011 tempest-VolumesSnapshotsTestJSON-544723011-project] HTTP exception thrown: Snapshot 382266a1-bb29-4d73-b0f6-4642b5b8d26b could not be found. Jul 21 10:46:24.200801 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-2ecbe370-cd38-4005-b113-d797effffb24 tempest-VolumesSnapshotsTestJSON-544723011 tempest-VolumesSnapshotsTestJSON-544723011-project] Request method failure captured: Jul 21 10:46:24.200801 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: request: GET /compute/v2.1/os-snapshots/382266a1-bb29-4d73-b0f6-4642b5b8d26b HTTP/1.1 Jul 21 10:46:24.200801 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Accept: application/json Jul 21 10:46:24.200801 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Accept-Encoding: identity Jul 21 10:46:24.200801 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Connection: close Jul 21 10:46:24.200801 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Content-Length: 0 Jul 21 10:46:24.200801 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Content-Type: application/json Jul 21 10:46:24.200801 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Host: 10.222.0.48 Jul 21 10:46:24.200801 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Openstack-System-Scope: None Jul 21 10:46:24.200801 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: User-Agent: python-urllib3/1.26.9 Jul 21 10:46:24.200801 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Auth-Token: gAAAAABi2S5y1i8vE9NqxnalDNBxP5TA65D0Nrd-DboDfMNQQ0QnoBDPJU5HPO30a92KMpDlFEIj-deodz3DXqOOYPJCXYkac4nt2W0_wM4Mk8khJ0BFJgTDBNP_yxfZfvBhVYEVlNF8jfkAdr9L0ybNcmMZ7sxY4__OGt0rkdIf7V4IhQYauRg Jul 21 10:46:24.200801 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Domain-Id: None Jul 21 10:46:24.200801 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Domain-Name: None Jul 21 10:46:24.200801 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Identity-Status: Confirmed Jul 21 10:46:24.200801 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Is-Admin-Project: True Jul 21 10:46:24.200801 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Project-Domain-Id: default Jul 21 10:46:24.200801 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Project-Domain-Name: Default Jul 21 10:46:24.200801 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Project-Id: 8f934391f10a47069cbfd9bfe3573e02 Jul 21 10:46:24.200801 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-544723011 Jul 21 10:46:24.200801 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Role: reader,member Jul 21 10:46:24.200801 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Roles: reader,member Jul 21 10:46:24.202142 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8f934391f10a47069cbfd9bfe3573e02"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8f934391f10a47069cbfd9bfe3573e02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8f934391f10a47069cbfd9bfe3573e02"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8f934391f10a47069cbfd9bfe3573e02"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] Jul 21 10:46:24.202142 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Tenant: tempest-VolumesSnapshotsTestJSON-544723011 Jul 21 10:46:24.202142 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Tenant-Id: 8f934391f10a47069cbfd9bfe3573e02 Jul 21 10:46:24.202142 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-544723011 Jul 21 10:46:24.202142 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User: tempest-VolumesSnapshotsTestJSON-544723011-project Jul 21 10:46:24.202142 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User-Domain-Id: default Jul 21 10:46:24.202142 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User-Domain-Name: Default Jul 21 10:46:24.202142 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User-Id: 50d01be572d24e5db36c2863ab15f11a Jul 21 10:46:24.202142 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User-Name: tempest-VolumesSnapshotsTestJSON-544723011-project Jul 21 10:46:24.202142 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: method: Jul 21 10:46:24.202142 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: exception: Snapshot 382266a1-bb29-4d73-b0f6-4642b5b8d26b could not be found. Jul 21 10:46:24.202142 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: action_args: {'id': '382266a1-bb29-4d73-b0f6-4642b5b8d26b'} Jul 21 10:46:24.202142 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 10:46:24.202942 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:46:24.202942 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 21 10:46:24.202942 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 21 10:46:24.202942 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 21 10:46:24.202942 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 21 10:46:24.202942 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 21 10:46:24.202942 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 21 10:46:24.202942 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 10:46:24.202942 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 10:46:24.202942 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 10:46:24.202942 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 10:46:24.202942 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 10:46:24.202942 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 10:46:24.202942 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 10:46:24.202942 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 10:46:24.202942 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 382266a1-bb29-4d73-b0f6-4642b5b8d26b could not be found. (HTTP 404) (Request-ID: req-7a315a8e-8aa4-4ee0-a7ce-a323dfecd2cb) Jul 21 10:46:24.202942 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:46:24.202942 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:46:24.203991 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:46:24.203991 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:46:24.203991 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 21 10:46:24.203991 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 21 10:46:24.203991 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 10:46:24.203991 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 10:46:24.203991 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 21 10:46:24.203991 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 21 10:46:24.203991 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 21 10:46:24.203991 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 21 10:46:24.203991 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 21 10:46:24.203991 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 21 10:46:24.203991 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 21 10:46:24.203991 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 21 10:46:24.203991 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 21 10:46:24.203991 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 21 10:46:24.203991 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 10:46:24.203991 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 10:46:24.203991 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 10:46:24.205122 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 10:46:24.205122 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 10:46:24.205122 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 10:46:24.205122 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 10:46:24.205122 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 10:46:24.205122 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 382266a1-bb29-4d73-b0f6-4642b5b8d26b could not be found. Jul 21 10:46:24.205122 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:46:24.205122 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:46:24.205122 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:46:24.205122 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:46:24.205122 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:46:24.205122 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:46:24.205122 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 10:46:24.205122 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 10:46:24.205122 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 10:46:24.205122 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 10:46:24.205122 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 10:46:24.205122 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 10:46:24.205122 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 21 10:46:24.205122 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 10:46:24.206295 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 382266a1-bb29-4d73-b0f6-4642b5b8d26b could not be found. Jul 21 10:46:24.206295 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:46:24.206295 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:46:24.206295 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:46:24.206295 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:46:24.206295 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:46:24.206295 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:46:24.206295 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 10:46:24.206295 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 10:46:24.206295 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 382266a1-bb29-4d73-b0f6-4642b5b8d26b could not be found. Jul 21 10:46:24.206295 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:46:24.208006 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-2ecbe370-cd38-4005-b113-d797effffb24 tempest-VolumesSnapshotsTestJSON-544723011 tempest-VolumesSnapshotsTestJSON-544723011-project] Returning 404 to user: Snapshot 382266a1-bb29-4d73-b0f6-4642b5b8d26b could not be found. {{(pid=124867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 10:46:24.210200 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-2ecbe370-cd38-4005-b113-d797effffb24 tempest-VolumesSnapshotsTestJSON-544723011 tempest-VolumesSnapshotsTestJSON-544723011-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/382266a1-bb29-4d73-b0f6-4642b5b8d26b" status: 404 len: 111 microversion: 2.1 time: 0.059925 Jul 21 10:46:24.210626 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 8/23] 10.222.0.48 () {58 vars in 1250 bytes} [Thu Jul 21 10:46:24 2022] GET /compute/v2.1/os-snapshots/382266a1-bb29-4d73-b0f6-4642b5b8d26b => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 21 10:46:24.219676 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-d785c659-69d0-4ebd-844c-4e0cc9d9af55 tempest-VolumesSnapshotsTestJSON-544723011 tempest-VolumesSnapshotsTestJSON-544723011-project] Calling method '.version_select at 0x7f7965177820>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:46:24.542470 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-d785c659-69d0-4ebd-844c-4e0cc9d9af55 tempest-VolumesSnapshotsTestJSON-544723011 tempest-VolumesSnapshotsTestJSON-544723011-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/13acb49d-51d9-426a-a951-20b5a1b75d91" status: 202 len: 0 microversion: 2.1 time: 0.327827 Jul 21 10:46:24.546618 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 16/24] 10.222.0.48 () {58 vars in 1247 bytes} [Thu Jul 21 10:46:24 2022] DELETE /compute/v2.1/os-volumes/13acb49d-51d9-426a-a951-20b5a1b75d91 => generated 0 bytes in 333 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 10:46:24.551556 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-31031cb6-b312-4644-aa02-5aed69a6084f tempest-VolumesSnapshotsTestJSON-544723011 tempest-VolumesSnapshotsTestJSON-544723011-project] Calling method '.version_select at 0x7f79648b0ca0>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:46:24.689897 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-31031cb6-b312-4644-aa02-5aed69a6084f tempest-VolumesSnapshotsTestJSON-544723011 tempest-VolumesSnapshotsTestJSON-544723011-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/13acb49d-51d9-426a-a951-20b5a1b75d91" status: 200 len: 345 microversion: 2.1 time: 0.141293 Jul 21 10:46:24.690845 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 17/25] 10.222.0.48 () {58 vars in 1244 bytes} [Thu Jul 21 10:46:24 2022] GET /compute/v2.1/os-volumes/13acb49d-51d9-426a-a951-20b5a1b75d91 => generated 345 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:46:25.340641 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-1f6a97ac-8a29-4c71-9287-99d9754f255b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Action: 'create', calling method: .version_select at 0x7f7964897310>, body: {"keypair": {"name": "tempest-keypair-926267718", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOUiKOxwQSkutgSNgVf8tPFN0P32QdWWG1DQqDLwd2tdMeTf4O1kuUAobkq8qwsO5rklHakk2NatlLf8bCYeb+ze5wI/OgeZt+oURelnIBuDLd5Ei3JAIaiHvmWHy5chgg=="}} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:46:25.508682 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.quota [None req-1f6a97ac-8a29-4c71-9287-99d9754f255b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Getting quotas for project 29c1b9c9f7024f8494e0a9b58fe35710. Resources: {'key_pairs'} {{(pid=124867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 10:46:25.528527 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.quota [None req-1f6a97ac-8a29-4c71-9287-99d9754f255b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Getting quotas for user 23b63d44bb304e97a38acc6d0b791c95 and project 29c1b9c9f7024f8494e0a9b58fe35710. Resources: {'key_pairs'} {{(pid=124867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 10:46:25.704285 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-d65247d9-433e-436d-b97a-7eb6730efff1 tempest-VolumesSnapshotsTestJSON-544723011 tempest-VolumesSnapshotsTestJSON-544723011-project] Calling method '.version_select at 0x7f79648b0700>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:46:25.740117 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-1f6a97ac-8a29-4c71-9287-99d9754f255b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 1.211542 Jul 21 10:46:25.740775 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 9/26] 10.222.0.48 () {62 vars in 1199 bytes} [Thu Jul 21 10:46:24 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 1213 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 21 10:46:25.763409 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.wsgi [None req-d65247d9-433e-436d-b97a-7eb6730efff1 tempest-VolumesSnapshotsTestJSON-544723011 tempest-VolumesSnapshotsTestJSON-544723011-project] HTTP exception thrown: Volume 13acb49d-51d9-426a-a951-20b5a1b75d91 could not be found. Jul 21 10:46:25.763409 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-d65247d9-433e-436d-b97a-7eb6730efff1 tempest-VolumesSnapshotsTestJSON-544723011 tempest-VolumesSnapshotsTestJSON-544723011-project] Request method failure captured: Jul 21 10:46:25.763409 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: request: GET /compute/v2.1/os-volumes/13acb49d-51d9-426a-a951-20b5a1b75d91 HTTP/1.1 Jul 21 10:46:25.763409 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Accept: application/json Jul 21 10:46:25.763409 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Accept-Encoding: identity Jul 21 10:46:25.763409 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Connection: close Jul 21 10:46:25.763409 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Content-Length: 0 Jul 21 10:46:25.763409 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Content-Type: application/json Jul 21 10:46:25.763409 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Host: 10.222.0.48 Jul 21 10:46:25.763409 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Openstack-System-Scope: None Jul 21 10:46:25.763409 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: User-Agent: python-urllib3/1.26.9 Jul 21 10:46:25.763409 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Auth-Token: gAAAAABi2S5y1i8vE9NqxnalDNBxP5TA65D0Nrd-DboDfMNQQ0QnoBDPJU5HPO30a92KMpDlFEIj-deodz3DXqOOYPJCXYkac4nt2W0_wM4Mk8khJ0BFJgTDBNP_yxfZfvBhVYEVlNF8jfkAdr9L0ybNcmMZ7sxY4__OGt0rkdIf7V4IhQYauRg Jul 21 10:46:25.763409 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Domain-Id: None Jul 21 10:46:25.763409 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Domain-Name: None Jul 21 10:46:25.763409 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Identity-Status: Confirmed Jul 21 10:46:25.763409 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Is-Admin-Project: True Jul 21 10:46:25.763409 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Domain-Id: default Jul 21 10:46:25.763409 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Domain-Name: Default Jul 21 10:46:25.763409 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Id: 8f934391f10a47069cbfd9bfe3573e02 Jul 21 10:46:25.763409 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-544723011 Jul 21 10:46:25.763409 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Role: reader,member Jul 21 10:46:25.763409 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Roles: reader,member Jul 21 10:46:25.765078 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8f934391f10a47069cbfd9bfe3573e02"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8f934391f10a47069cbfd9bfe3573e02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8f934391f10a47069cbfd9bfe3573e02"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8f934391f10a47069cbfd9bfe3573e02"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] Jul 21 10:46:25.765078 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Tenant: tempest-VolumesSnapshotsTestJSON-544723011 Jul 21 10:46:25.765078 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Tenant-Id: 8f934391f10a47069cbfd9bfe3573e02 Jul 21 10:46:25.765078 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-544723011 Jul 21 10:46:25.765078 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User: tempest-VolumesSnapshotsTestJSON-544723011-project Jul 21 10:46:25.765078 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Domain-Id: default Jul 21 10:46:25.765078 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Domain-Name: Default Jul 21 10:46:25.765078 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Id: 50d01be572d24e5db36c2863ab15f11a Jul 21 10:46:25.765078 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Name: tempest-VolumesSnapshotsTestJSON-544723011-project Jul 21 10:46:25.765078 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: method: Jul 21 10:46:25.765078 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: exception: Volume 13acb49d-51d9-426a-a951-20b5a1b75d91 could not be found. Jul 21 10:46:25.765078 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: action_args: {'id': '13acb49d-51d9-426a-a951-20b5a1b75d91'} Jul 21 10:46:25.765078 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 10:46:25.765795 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:46:25.765795 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 10:46:25.765795 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 10:46:25.765795 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 21 10:46:25.765795 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 21 10:46:25.765795 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 21 10:46:25.765795 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 21 10:46:25.765795 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 10:46:25.765795 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 10:46:25.765795 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 10:46:25.765795 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 10:46:25.765795 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 10:46:25.765795 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 10:46:25.765795 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 10:46:25.765795 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 10:46:25.765795 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 13acb49d-51d9-426a-a951-20b5a1b75d91 could not be found. (HTTP 404) (Request-ID: req-857d10e9-d9d1-4429-8072-c2ddefc8c3af) Jul 21 10:46:25.765795 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:46:25.765795 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:46:25.765795 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:46:25.767011 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:46:25.767011 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 21 10:46:25.767011 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 21 10:46:25.767011 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 10:46:25.767011 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 10:46:25.767011 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 21 10:46:25.767011 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 21 10:46:25.767011 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 21 10:46:25.767011 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 21 10:46:25.767011 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 10:46:25.767011 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 10:46:25.767011 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 21 10:46:25.767011 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 21 10:46:25.767011 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 21 10:46:25.767011 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 21 10:46:25.767011 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 10:46:25.767011 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 10:46:25.767011 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 10:46:25.767011 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 10:46:25.767978 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 10:46:25.767978 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 10:46:25.767978 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 10:46:25.767978 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 10:46:25.767978 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 13acb49d-51d9-426a-a951-20b5a1b75d91 could not be found. Jul 21 10:46:25.767978 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:46:25.767978 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:46:25.767978 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:46:25.767978 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:46:25.767978 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:46:25.767978 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:46:25.767978 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 10:46:25.767978 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 10:46:25.767978 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 10:46:25.767978 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 10:46:25.767978 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 10:46:25.767978 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 10:46:25.767978 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 21 10:46:25.767978 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 10:46:25.769056 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 13acb49d-51d9-426a-a951-20b5a1b75d91 could not be found. Jul 21 10:46:25.769056 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:46:25.769056 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:46:25.769056 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:46:25.769056 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:46:25.769056 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:46:25.769056 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:46:25.769056 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 10:46:25.769056 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 10:46:25.769056 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 13acb49d-51d9-426a-a951-20b5a1b75d91 could not be found. Jul 21 10:46:25.769056 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:46:25.769056 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-d65247d9-433e-436d-b97a-7eb6730efff1 tempest-VolumesSnapshotsTestJSON-544723011 tempest-VolumesSnapshotsTestJSON-544723011-project] Returning 404 to user: Volume 13acb49d-51d9-426a-a951-20b5a1b75d91 could not be found. {{(pid=124868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 10:46:25.769056 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-d65247d9-433e-436d-b97a-7eb6730efff1 tempest-VolumesSnapshotsTestJSON-544723011 tempest-VolumesSnapshotsTestJSON-544723011-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/13acb49d-51d9-426a-a951-20b5a1b75d91" status: 404 len: 109 microversion: 2.1 time: 0.051066 Jul 21 10:46:25.769056 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 18/27] 10.222.0.48 () {58 vars in 1244 bytes} [Thu Jul 21 10:46:25 2022] GET /compute/v2.1/os-volumes/13acb49d-51d9-426a-a951-20b5a1b75d91 => generated 109 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 21 10:46:25.777731 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-e62094a5-8ead-4e7d-b4a4-3a22bc52ecdd tempest-VolumesSnapshotsTestJSON-544723011 tempest-VolumesSnapshotsTestJSON-544723011-project] Calling method '.version_select at 0x7f7964012160>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:46:25.851500 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.wsgi [None req-e62094a5-8ead-4e7d-b4a4-3a22bc52ecdd tempest-VolumesSnapshotsTestJSON-544723011 tempest-VolumesSnapshotsTestJSON-544723011-project] HTTP exception thrown: Volume 13acb49d-51d9-426a-a951-20b5a1b75d91 could not be found. Jul 21 10:46:25.858525 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-e62094a5-8ead-4e7d-b4a4-3a22bc52ecdd tempest-VolumesSnapshotsTestJSON-544723011 tempest-VolumesSnapshotsTestJSON-544723011-project] Request method failure captured: Jul 21 10:46:25.858525 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: request: DELETE /compute/v2.1/os-volumes/13acb49d-51d9-426a-a951-20b5a1b75d91 HTTP/1.1 Jul 21 10:46:25.858525 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Accept: application/json Jul 21 10:46:25.858525 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Accept-Encoding: identity Jul 21 10:46:25.858525 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Connection: close Jul 21 10:46:25.858525 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Content-Length: 0 Jul 21 10:46:25.858525 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Content-Type: application/json Jul 21 10:46:25.858525 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Host: 10.222.0.48 Jul 21 10:46:25.858525 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Openstack-System-Scope: None Jul 21 10:46:25.858525 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: User-Agent: python-urllib3/1.26.9 Jul 21 10:46:25.858525 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Auth-Token: gAAAAABi2S5y1i8vE9NqxnalDNBxP5TA65D0Nrd-DboDfMNQQ0QnoBDPJU5HPO30a92KMpDlFEIj-deodz3DXqOOYPJCXYkac4nt2W0_wM4Mk8khJ0BFJgTDBNP_yxfZfvBhVYEVlNF8jfkAdr9L0ybNcmMZ7sxY4__OGt0rkdIf7V4IhQYauRg Jul 21 10:46:25.858525 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Domain-Id: None Jul 21 10:46:25.858525 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Domain-Name: None Jul 21 10:46:25.858525 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Identity-Status: Confirmed Jul 21 10:46:25.858525 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Is-Admin-Project: True Jul 21 10:46:25.858525 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Project-Domain-Id: default Jul 21 10:46:25.858525 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Project-Domain-Name: Default Jul 21 10:46:25.858525 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Project-Id: 8f934391f10a47069cbfd9bfe3573e02 Jul 21 10:46:25.858525 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-544723011 Jul 21 10:46:25.858525 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Role: reader,member Jul 21 10:46:25.858525 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Roles: reader,member Jul 21 10:46:25.865244 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8f934391f10a47069cbfd9bfe3573e02"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8f934391f10a47069cbfd9bfe3573e02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8f934391f10a47069cbfd9bfe3573e02"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8f934391f10a47069cbfd9bfe3573e02"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] Jul 21 10:46:25.865244 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Tenant: tempest-VolumesSnapshotsTestJSON-544723011 Jul 21 10:46:25.865244 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Tenant-Id: 8f934391f10a47069cbfd9bfe3573e02 Jul 21 10:46:25.865244 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-544723011 Jul 21 10:46:25.865244 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User: tempest-VolumesSnapshotsTestJSON-544723011-project Jul 21 10:46:25.865244 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User-Domain-Id: default Jul 21 10:46:25.865244 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User-Domain-Name: Default Jul 21 10:46:25.865244 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User-Id: 50d01be572d24e5db36c2863ab15f11a Jul 21 10:46:25.865244 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User-Name: tempest-VolumesSnapshotsTestJSON-544723011-project Jul 21 10:46:25.865244 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: method: Jul 21 10:46:25.865244 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: exception: Volume 13acb49d-51d9-426a-a951-20b5a1b75d91 could not be found. Jul 21 10:46:25.865244 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: action_args: {'id': '13acb49d-51d9-426a-a951-20b5a1b75d91'} Jul 21 10:46:25.865244 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 10:46:25.866013 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:46:25.866013 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 10:46:25.866013 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 10:46:25.866013 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 21 10:46:25.866013 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 21 10:46:25.866013 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 21 10:46:25.866013 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 21 10:46:25.866013 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 21 10:46:25.866013 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 21 10:46:25.866013 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 21 10:46:25.866013 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 21 10:46:25.866013 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 10:46:25.866013 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 10:46:25.866013 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 10:46:25.866013 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 10:46:25.866013 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 13acb49d-51d9-426a-a951-20b5a1b75d91 could not be found. (HTTP 404) (Request-ID: req-8caf8dd0-afc5-4068-ad08-d6f51b318e9c) Jul 21 10:46:25.866013 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:46:25.866013 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:46:25.866013 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:46:25.867064 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:46:25.867064 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 21 10:46:25.867064 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 21 10:46:25.867064 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 10:46:25.867064 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 10:46:25.867064 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 21 10:46:25.867064 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 21 10:46:25.867064 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 21 10:46:25.867064 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 21 10:46:25.867064 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 10:46:25.867064 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 10:46:25.867064 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 21 10:46:25.867064 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 21 10:46:25.867064 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 21 10:46:25.867064 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 21 10:46:25.867064 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 21 10:46:25.867064 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 21 10:46:25.867064 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 21 10:46:25.867064 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 21 10:46:25.868511 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 10:46:25.868511 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 10:46:25.868511 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 10:46:25.868511 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 10:46:25.868511 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 13acb49d-51d9-426a-a951-20b5a1b75d91 could not be found. Jul 21 10:46:25.868511 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:46:25.868511 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:46:25.868511 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:46:25.868511 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:46:25.868511 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:46:25.868511 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:46:25.868511 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 10:46:25.868511 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 10:46:25.868511 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 10:46:25.868511 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 10:46:25.868511 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 10:46:25.868511 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 10:46:25.868511 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 21 10:46:25.868511 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 10:46:25.879515 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 13acb49d-51d9-426a-a951-20b5a1b75d91 could not be found. Jul 21 10:46:25.879515 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:46:25.879515 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:46:25.879515 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:46:25.879515 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:46:25.879515 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:46:25.879515 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:46:25.879515 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 10:46:25.879515 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 10:46:25.879515 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 13acb49d-51d9-426a-a951-20b5a1b75d91 could not be found. Jul 21 10:46:25.879515 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:46:25.879515 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-e62094a5-8ead-4e7d-b4a4-3a22bc52ecdd tempest-VolumesSnapshotsTestJSON-544723011 tempest-VolumesSnapshotsTestJSON-544723011-project] Returning 404 to user: Volume 13acb49d-51d9-426a-a951-20b5a1b75d91 could not be found. {{(pid=124867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 10:46:25.879515 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-e62094a5-8ead-4e7d-b4a4-3a22bc52ecdd tempest-VolumesSnapshotsTestJSON-544723011 tempest-VolumesSnapshotsTestJSON-544723011-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/13acb49d-51d9-426a-a951-20b5a1b75d91" status: 404 len: 109 microversion: 2.1 time: 0.093719 Jul 21 10:46:25.879515 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 10/28] 10.222.0.48 () {58 vars in 1247 bytes} [Thu Jul 21 10:46:25 2022] DELETE /compute/v2.1/os-volumes/13acb49d-51d9-426a-a951-20b5a1b75d91 => generated 109 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 10:46:25.892914 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-d9a351da-a413-4b62-b2d9-17a160de00ab tempest-VolumesSnapshotsTestJSON-544723011 tempest-VolumesSnapshotsTestJSON-544723011-project] Calling method '.version_select at 0x7f79648d63a0>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:46:25.936556 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.wsgi [None req-d9a351da-a413-4b62-b2d9-17a160de00ab tempest-VolumesSnapshotsTestJSON-544723011 tempest-VolumesSnapshotsTestJSON-544723011-project] HTTP exception thrown: Volume 13acb49d-51d9-426a-a951-20b5a1b75d91 could not be found. Jul 21 10:46:25.939276 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-d9a351da-a413-4b62-b2d9-17a160de00ab tempest-VolumesSnapshotsTestJSON-544723011 tempest-VolumesSnapshotsTestJSON-544723011-project] Request method failure captured: Jul 21 10:46:25.939276 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: request: GET /compute/v2.1/os-volumes/13acb49d-51d9-426a-a951-20b5a1b75d91 HTTP/1.1 Jul 21 10:46:25.939276 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Accept: application/json Jul 21 10:46:25.939276 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Accept-Encoding: identity Jul 21 10:46:25.939276 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Connection: close Jul 21 10:46:25.939276 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Content-Length: 0 Jul 21 10:46:25.939276 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Content-Type: application/json Jul 21 10:46:25.939276 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Host: 10.222.0.48 Jul 21 10:46:25.939276 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Openstack-System-Scope: None Jul 21 10:46:25.939276 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: User-Agent: python-urllib3/1.26.9 Jul 21 10:46:25.939276 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Auth-Token: gAAAAABi2S5y1i8vE9NqxnalDNBxP5TA65D0Nrd-DboDfMNQQ0QnoBDPJU5HPO30a92KMpDlFEIj-deodz3DXqOOYPJCXYkac4nt2W0_wM4Mk8khJ0BFJgTDBNP_yxfZfvBhVYEVlNF8jfkAdr9L0ybNcmMZ7sxY4__OGt0rkdIf7V4IhQYauRg Jul 21 10:46:25.939276 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Domain-Id: None Jul 21 10:46:25.939276 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Domain-Name: None Jul 21 10:46:25.939276 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Identity-Status: Confirmed Jul 21 10:46:25.939276 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Is-Admin-Project: True Jul 21 10:46:25.939276 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Domain-Id: default Jul 21 10:46:25.939276 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Domain-Name: Default Jul 21 10:46:25.939276 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Id: 8f934391f10a47069cbfd9bfe3573e02 Jul 21 10:46:25.939276 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-544723011 Jul 21 10:46:25.939276 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Role: reader,member Jul 21 10:46:25.939276 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Roles: reader,member Jul 21 10:46:25.940481 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8f934391f10a47069cbfd9bfe3573e02"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8f934391f10a47069cbfd9bfe3573e02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8f934391f10a47069cbfd9bfe3573e02"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8f934391f10a47069cbfd9bfe3573e02"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] Jul 21 10:46:25.940481 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Tenant: tempest-VolumesSnapshotsTestJSON-544723011 Jul 21 10:46:25.940481 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Tenant-Id: 8f934391f10a47069cbfd9bfe3573e02 Jul 21 10:46:25.940481 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-544723011 Jul 21 10:46:25.940481 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User: tempest-VolumesSnapshotsTestJSON-544723011-project Jul 21 10:46:25.940481 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Domain-Id: default Jul 21 10:46:25.940481 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Domain-Name: Default Jul 21 10:46:25.940481 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Id: 50d01be572d24e5db36c2863ab15f11a Jul 21 10:46:25.940481 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Name: tempest-VolumesSnapshotsTestJSON-544723011-project Jul 21 10:46:25.940481 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: method: Jul 21 10:46:25.940481 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: exception: Volume 13acb49d-51d9-426a-a951-20b5a1b75d91 could not be found. Jul 21 10:46:25.940481 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: action_args: {'id': '13acb49d-51d9-426a-a951-20b5a1b75d91'} Jul 21 10:46:25.940481 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 10:46:25.941145 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:46:25.941145 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 10:46:25.941145 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 10:46:25.941145 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 21 10:46:25.941145 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 21 10:46:25.941145 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 21 10:46:25.941145 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 21 10:46:25.941145 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 10:46:25.941145 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 10:46:25.941145 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 10:46:25.941145 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 10:46:25.941145 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 10:46:25.941145 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 10:46:25.941145 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 10:46:25.941145 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 10:46:25.941145 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 13acb49d-51d9-426a-a951-20b5a1b75d91 could not be found. (HTTP 404) (Request-ID: req-258fa3b9-9a37-46d6-93e2-c0d8a8bd741d) Jul 21 10:46:25.941145 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:46:25.941145 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:46:25.941145 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:46:25.942061 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:46:25.942061 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 21 10:46:25.942061 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 21 10:46:25.942061 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 10:46:25.942061 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 10:46:25.942061 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 21 10:46:25.942061 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 21 10:46:25.942061 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 21 10:46:25.942061 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 21 10:46:25.942061 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 10:46:25.942061 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 10:46:25.942061 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 21 10:46:25.942061 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 21 10:46:25.942061 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 21 10:46:25.942061 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 21 10:46:25.942061 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 10:46:25.942061 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 10:46:25.942061 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 10:46:25.942061 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 10:46:25.942988 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 10:46:25.942988 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 10:46:25.942988 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 10:46:25.942988 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 10:46:25.942988 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 13acb49d-51d9-426a-a951-20b5a1b75d91 could not be found. Jul 21 10:46:25.942988 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:46:25.942988 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:46:25.942988 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:46:25.942988 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:46:25.942988 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:46:25.942988 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:46:25.942988 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 10:46:25.942988 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 10:46:25.942988 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 10:46:25.942988 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 10:46:25.942988 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 10:46:25.942988 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 10:46:25.942988 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 21 10:46:25.942988 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 10:46:25.948328 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 13acb49d-51d9-426a-a951-20b5a1b75d91 could not be found. Jul 21 10:46:25.948328 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:46:25.948328 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:46:25.948328 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:46:25.948328 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:46:25.948328 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:46:25.948328 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:46:25.948328 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 10:46:25.948328 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 10:46:25.948328 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 13acb49d-51d9-426a-a951-20b5a1b75d91 could not be found. Jul 21 10:46:25.948328 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:46:25.951933 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-d9a351da-a413-4b62-b2d9-17a160de00ab tempest-VolumesSnapshotsTestJSON-544723011 tempest-VolumesSnapshotsTestJSON-544723011-project] Returning 404 to user: Volume 13acb49d-51d9-426a-a951-20b5a1b75d91 could not be found. {{(pid=124868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 10:46:25.953752 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-d9a351da-a413-4b62-b2d9-17a160de00ab tempest-VolumesSnapshotsTestJSON-544723011 tempest-VolumesSnapshotsTestJSON-544723011-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/13acb49d-51d9-426a-a951-20b5a1b75d91" status: 404 len: 109 microversion: 2.1 time: 0.067128 Jul 21 10:46:25.961593 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 19/29] 10.222.0.48 () {58 vars in 1244 bytes} [Thu Jul 21 10:46:25 2022] GET /compute/v2.1/os-volumes/13acb49d-51d9-426a-a951-20b5a1b75d91 => generated 109 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 10:46:26.920865 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-d7ea01cb-4ce4-4ca9-b862-66f41672be3c tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1435441164", "imageRef": "282ddb30-fa0f-489d-9cc3-a3e70e03c631", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:46:27.122744 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.network.neutron [None req-d7ea01cb-4ce4-4ca9-b862-66f41672be3c tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] validate_networks() for [('c6051ff4-8399-4b19-9b2a-895d18fcb35a', None, None, None, None, None)] {{(pid=124867) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 10:46:28.153867 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-4fb88131-aefa-45b9-a29e-8b6790d733b9 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-918583009", "imageRef": "282ddb30-fa0f-489d-9cc3-a3e70e03c631", "flavorRef": "452", "networks": [{"uuid": "a0a9180e-0a1e-4a60-91ec-2707820a22f4"}]}} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:46:28.364741 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.network.neutron [None req-4fb88131-aefa-45b9-a29e-8b6790d733b9 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] validate_networks() for [('a0a9180e-0a1e-4a60-91ec-2707820a22f4', None, None, None, None, None)] {{(pid=124868) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 10:46:29.597143 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-d7ea01cb-4ce4-4ca9-b862-66f41672be3c tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Flavor limits 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 10:46:29.597994 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-d7ea01cb-4ce4-4ca9-b862-66f41672be3c tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Image limits 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 10:46:29.598670 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-d7ea01cb-4ce4-4ca9-b862-66f41672be3c tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Flavor pref 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 10:46:29.599092 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-d7ea01cb-4ce4-4ca9-b862-66f41672be3c tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Image pref 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 10:46:29.599567 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-d7ea01cb-4ce4-4ca9-b862-66f41672be3c tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 10:46:29.629991 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d7ea01cb-4ce4-4ca9-b862-66f41672be3c tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:29.630641 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d7ea01cb-4ce4-4ca9-b862-66f41672be3c tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:29.641328 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d7ea01cb-4ce4-4ca9-b862-66f41672be3c tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:29.642150 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d7ea01cb-4ce4-4ca9-b862-66f41672be3c tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:29.731249 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.quota [None req-d7ea01cb-4ce4-4ca9-b862-66f41672be3c tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Getting quotas for project 2ff45af5bd82457b9fd080026ea65b5b. Resources: {'ram', 'instances', 'cores'} {{(pid=124867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 10:46:29.744879 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.quota [None req-d7ea01cb-4ce4-4ca9-b862-66f41672be3c tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Getting quotas for user a2cb1079722947dfa37946c03b7297a3 and project 2ff45af5bd82457b9fd080026ea65b5b. Resources: {'ram', 'instances', 'cores'} {{(pid=124867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 10:46:29.783638 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-d7ea01cb-4ce4-4ca9-b862-66f41672be3c tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Going to run 1 instances... {{(pid=124867) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 10:46:29.800290 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-d7ea01cb-4ce4-4ca9-b862-66f41672be3c tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: b7a76827-1907-4bf4-b27c-945b33b2316d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='282ddb30-fa0f-489d-9cc3-a3e70e03c631',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124867) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 10:46:30.104615 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-d7ea01cb-4ce4-4ca9-b862-66f41672be3c tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.599416 Jul 21 10:46:30.105498 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 11/30] 10.222.0.48 () {60 vars in 1146 bytes} [Thu Jul 21 10:46:26 2022] POST /compute/v2.1/servers => generated 383 bytes in 3603 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 10:46:30.132140 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-aa958887-73ca-4bb3-8ce1-e945110d799e tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:46:30.135623 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-aa958887-73ca-4bb3-8ce1-e945110d799e tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: b7a76827-1907-4bf4-b27c-945b33b2316d] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:46:30.750170 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-aa958887-73ca-4bb3-8ce1-e945110d799e tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:46:30.778945 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-aa958887-73ca-4bb3-8ce1-e945110d799e tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/b7a76827-1907-4bf4-b27c-945b33b2316d" status: 200 len: 1222 microversion: 2.1 time: 0.665368 Jul 21 10:46:30.779537 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 12/31] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:46:30 2022] GET /compute/v2.1/servers/b7a76827-1907-4bf4-b27c-945b33b2316d => generated 1222 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:46:32.040131 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.virt.hardware [None req-4fb88131-aefa-45b9-a29e-8b6790d733b9 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Flavor limits 0:0:0 {{(pid=124868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 10:46:32.040858 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.virt.hardware [None req-4fb88131-aefa-45b9-a29e-8b6790d733b9 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Image limits 0:0:0 {{(pid=124868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 10:46:32.041462 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.virt.hardware [None req-4fb88131-aefa-45b9-a29e-8b6790d733b9 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Flavor pref 0:0:0 {{(pid=124868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 10:46:32.042248 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.virt.hardware [None req-4fb88131-aefa-45b9-a29e-8b6790d733b9 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Image pref 0:0:0 {{(pid=124868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 10:46:32.042709 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.virt.hardware [None req-4fb88131-aefa-45b9-a29e-8b6790d733b9 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 10:46:32.048035 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-1d49dc1f-fece-4bda-b30d-7388efdb978c tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-534180962", "imageRef": "282ddb30-fa0f-489d-9cc3-a3e70e03c631", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:46:32.085041 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4fb88131-aefa-45b9-a29e-8b6790d733b9 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:32.085494 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4fb88131-aefa-45b9-a29e-8b6790d733b9 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:32.086314 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4fb88131-aefa-45b9-a29e-8b6790d733b9 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:32.090937 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4fb88131-aefa-45b9-a29e-8b6790d733b9 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:32.206887 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.network.neutron [None req-1d49dc1f-fece-4bda-b30d-7388efdb978c tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] validate_networks() for [('c6051ff4-8399-4b19-9b2a-895d18fcb35a', None, None, None, None, None)] {{(pid=124867) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 10:46:32.219131 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.quota [None req-4fb88131-aefa-45b9-a29e-8b6790d733b9 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Getting quotas for project 9ceeabe5ea2a4a24b28901f50be5d532. Resources: {'ram', 'instances', 'cores'} {{(pid=124868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 10:46:32.244465 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.quota [None req-4fb88131-aefa-45b9-a29e-8b6790d733b9 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Getting quotas for user ad7606b56fec4723b733f838ec34a17e and project 9ceeabe5ea2a4a24b28901f50be5d532. Resources: {'ram', 'instances', 'cores'} {{(pid=124868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 10:46:32.268067 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-4fb88131-aefa-45b9-a29e-8b6790d733b9 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Going to run 1 instances... {{(pid=124868) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 10:46:32.271496 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-4fb88131-aefa-45b9-a29e-8b6790d733b9 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] [instance: 2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='282ddb30-fa0f-489d-9cc3-a3e70e03c631',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 10:46:32.518009 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-4fb88131-aefa-45b9-a29e-8b6790d733b9 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.706975 Jul 21 10:46:32.521596 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 20/32] 10.222.0.48 () {60 vars in 1146 bytes} [Thu Jul 21 10:46:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 4713 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 10:46:32.543181 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-3eb3bf22-3ee9-4172-ad92-d14f2c3dbe04 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2138096562", "imageRef": "282ddb30-fa0f-489d-9cc3-a3e70e03c631", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c770f837-eda0-4a68-b0cf-fd07722be163"}], "security_groups": [{"name": "tempest-securitygroup--1658814861"}], "key_name": "tempest-keypair-926267718", "user_data": "}} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:46:33.151632 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.network.neutron [None req-3eb3bf22-3ee9-4172-ad92-d14f2c3dbe04 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] validate_networks() for [('c770f837-eda0-4a68-b0cf-fd07722be163', None, None, None, None, None)] {{(pid=124868) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 10:46:35.269834 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.virt.hardware [None req-3eb3bf22-3ee9-4172-ad92-d14f2c3dbe04 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Flavor limits 0:0:0 {{(pid=124868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 10:46:35.270491 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.virt.hardware [None req-3eb3bf22-3ee9-4172-ad92-d14f2c3dbe04 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Image limits 0:0:0 {{(pid=124868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 10:46:35.270892 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.virt.hardware [None req-3eb3bf22-3ee9-4172-ad92-d14f2c3dbe04 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Flavor pref 0:0:0 {{(pid=124868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 10:46:35.273319 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.virt.hardware [None req-3eb3bf22-3ee9-4172-ad92-d14f2c3dbe04 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Image pref 0:0:0 {{(pid=124868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 10:46:35.274512 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.virt.hardware [None req-3eb3bf22-3ee9-4172-ad92-d14f2c3dbe04 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 10:46:35.300297 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3eb3bf22-3ee9-4172-ad92-d14f2c3dbe04 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:35.300749 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3eb3bf22-3ee9-4172-ad92-d14f2c3dbe04 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:35.302031 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-1d49dc1f-fece-4bda-b30d-7388efdb978c tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Flavor limits 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 10:46:35.303091 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3eb3bf22-3ee9-4172-ad92-d14f2c3dbe04 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:35.304322 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-1d49dc1f-fece-4bda-b30d-7388efdb978c tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Image limits 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 10:46:35.305153 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-1d49dc1f-fece-4bda-b30d-7388efdb978c tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Flavor pref 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 10:46:35.305914 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-1d49dc1f-fece-4bda-b30d-7388efdb978c tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Image pref 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 10:46:35.307960 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-1d49dc1f-fece-4bda-b30d-7388efdb978c tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 10:46:35.311991 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3eb3bf22-3ee9-4172-ad92-d14f2c3dbe04 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:35.342675 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1d49dc1f-fece-4bda-b30d-7388efdb978c tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:35.343705 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1d49dc1f-fece-4bda-b30d-7388efdb978c tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:35.347666 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1d49dc1f-fece-4bda-b30d-7388efdb978c tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:35.350351 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1d49dc1f-fece-4bda-b30d-7388efdb978c tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:35.361268 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.quota [None req-3eb3bf22-3ee9-4172-ad92-d14f2c3dbe04 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Getting quotas for project 29c1b9c9f7024f8494e0a9b58fe35710. Resources: {'ram', 'instances', 'cores'} {{(pid=124868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 10:46:35.392261 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.quota [None req-3eb3bf22-3ee9-4172-ad92-d14f2c3dbe04 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Getting quotas for user 23b63d44bb304e97a38acc6d0b791c95 and project 29c1b9c9f7024f8494e0a9b58fe35710. Resources: {'ram', 'instances', 'cores'} {{(pid=124868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 10:46:35.401992 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.quota [None req-1d49dc1f-fece-4bda-b30d-7388efdb978c tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Getting quotas for project 2ff45af5bd82457b9fd080026ea65b5b. Resources: {'ram', 'instances', 'cores'} {{(pid=124867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 10:46:35.407142 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.quota [None req-1d49dc1f-fece-4bda-b30d-7388efdb978c tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Getting quotas for user a2cb1079722947dfa37946c03b7297a3 and project 2ff45af5bd82457b9fd080026ea65b5b. Resources: {'ram', 'instances', 'cores'} {{(pid=124867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 10:46:35.421194 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-3eb3bf22-3ee9-4172-ad92-d14f2c3dbe04 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Going to run 1 instances... {{(pid=124868) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 10:46:35.428241 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-3eb3bf22-3ee9-4172-ad92-d14f2c3dbe04 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='282ddb30-fa0f-489d-9cc3-a3e70e03c631',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 10:46:35.430381 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-1d49dc1f-fece-4bda-b30d-7388efdb978c tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Going to run 1 instances... {{(pid=124867) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 10:46:35.434383 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-1d49dc1f-fece-4bda-b30d-7388efdb978c tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: 86715109-fd38-41f4-b384-a319c310fc44] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='282ddb30-fa0f-489d-9cc3-a3e70e03c631',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124867) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 10:46:35.690691 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-3eb3bf22-3ee9-4172-ad92-d14f2c3dbe04 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 3.167572 Jul 21 10:46:35.695984 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-1d49dc1f-fece-4bda-b30d-7388efdb978c tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.652327 Jul 21 10:46:35.697057 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 21/33] 10.222.0.48 () {62 vars in 1187 bytes} [Thu Jul 21 10:46:32 2022] POST /compute/v2.1/servers => generated 402 bytes in 3174 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 21 10:46:35.697936 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 13/34] 10.222.0.48 () {60 vars in 1146 bytes} [Thu Jul 21 10:46:32 2022] POST /compute/v2.1/servers => generated 383 bytes in 3655 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 10:46:35.707522 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-8d0e2c3d-be4f-4c4f-a807-fbec28419888 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:46:35.708772 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-8d0e2c3d-be4f-4c4f-a807-fbec28419888 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] [instance: 2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:46:35.731822 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8d0e2c3d-be4f-4c4f-a807-fbec28419888 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:35.732455 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8d0e2c3d-be4f-4c4f-a807-fbec28419888 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:35.733611 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8d0e2c3d-be4f-4c4f-a807-fbec28419888 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:35.734362 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8d0e2c3d-be4f-4c4f-a807-fbec28419888 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:36.043938 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-8d0e2c3d-be4f-4c4f-a807-fbec28419888 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7606b56fec4723b733f838ec34a17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceeabe5ea2a4a24b28901f50be5d532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:46:36.091272 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-8d0e2c3d-be4f-4c4f-a807-fbec28419888 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] 10.222.0.48 "GET /compute/v2.1/servers/2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985" status: 200 len: 1210 microversion: 2.1 time: 0.379480 Jul 21 10:46:36.091272 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 22/35] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:46:35 2022] GET /compute/v2.1/servers/2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985 => generated 1210 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:46:36.096614 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-cad8e0c6-d7e0-4d7b-b9de-2bd3af1e7acd tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:46:36.096614 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-cad8e0c6-d7e0-4d7b-b9de-2bd3af1e7acd tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:46:36.461522 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-cad8e0c6-d7e0-4d7b-b9de-2bd3af1e7acd tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:46:36.461522 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-cad8e0c6-d7e0-4d7b-b9de-2bd3af1e7acd tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:46:36.464209 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-cad8e0c6-d7e0-4d7b-b9de-2bd3af1e7acd tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:46:36.464209 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-cad8e0c6-d7e0-4d7b-b9de-2bd3af1e7acd tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1281 microversion: 2.20 time: 0.169035 Jul 21 10:46:36.464209 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 23/36] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:46:36 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1281 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:46:36.464209 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-bba9c1fd-1014-4956-a1c8-5bd16e3b08f2 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:46:36.464832 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-bba9c1fd-1014-4956-a1c8-5bd16e3b08f2 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: 86715109-fd38-41f4-b384-a319c310fc44] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:46:36.464832 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-bba9c1fd-1014-4956-a1c8-5bd16e3b08f2 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:46:36.464832 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-bba9c1fd-1014-4956-a1c8-5bd16e3b08f2 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44" status: 200 len: 1221 microversion: 2.1 time: 0.084945 Jul 21 10:46:36.464832 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 24/37] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:46:36 2022] GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44 => generated 1221 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:46:36.494992 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-00a10a88-6da4-44c1-80f0-fecb5b54898b tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Action: 'create', calling method: .version_select at 0x7f795ffa2ee0>, body: {"keypair": {"name": "tempest-keypair-2047653555", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM+Z/1I3grDiHq9DgiMuriyzd23R676T3ZfDaifyRPXeD68f/Wh+gTZPy+lVbEKutVjV9QAu+MnlybC7E7VadNKfRCX9I8AYXc0k3ZpnUti6aaL7qmVQqVl3rxN0dQm2aA=="}} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:46:36.553945 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.quota [None req-00a10a88-6da4-44c1-80f0-fecb5b54898b tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Getting quotas for project 0dc215aadb5345d791945658832aae4a. Resources: {'key_pairs'} {{(pid=124867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 10:46:36.559312 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.quota [None req-00a10a88-6da4-44c1-80f0-fecb5b54898b tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Getting quotas for user 906e4bc4e9cc45ecb01cfca7918e461d and project 0dc215aadb5345d791945658832aae4a. Resources: {'key_pairs'} {{(pid=124867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 10:46:36.675197 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-00a10a88-6da4-44c1-80f0-fecb5b54898b tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.973811 Jul 21 10:46:36.676451 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 14/38] 10.222.0.48 () {60 vars in 1158 bytes} [Thu Jul 21 10:46:35 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:46:37.108834 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-fc2ce784-17f2-49ac-857c-c589e9ed05d5 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:46:37.109550 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-fc2ce784-17f2-49ac-857c-c589e9ed05d5 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] [instance: 2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:46:37.136808 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-fc2ce784-17f2-49ac-857c-c589e9ed05d5 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:37.138702 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-fc2ce784-17f2-49ac-857c-c589e9ed05d5 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:37.140952 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-fc2ce784-17f2-49ac-857c-c589e9ed05d5 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:37.141974 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-fc2ce784-17f2-49ac-857c-c589e9ed05d5 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:37.274893 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-a5157e81-0637-4647-9908-e3f69cb8ce69 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:46:37.275903 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-a5157e81-0637-4647-9908-e3f69cb8ce69 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:46:37.411568 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-fc2ce784-17f2-49ac-857c-c589e9ed05d5 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7606b56fec4723b733f838ec34a17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceeabe5ea2a4a24b28901f50be5d532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:46:37.421020 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-fc2ce784-17f2-49ac-857c-c589e9ed05d5 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] 10.222.0.48 "GET /compute/v2.1/servers/2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985" status: 200 len: 1274 microversion: 2.1 time: 0.320706 Jul 21 10:46:37.440840 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 25/39] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:46:37 2022] GET /compute/v2.1/servers/2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985 => generated 1274 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:46:37.481924 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-50766ed7-e159-44b7-be4a-38681a19421d tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:46:37.490485 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-50766ed7-e159-44b7-be4a-38681a19421d tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: 86715109-fd38-41f4-b384-a319c310fc44] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:46:37.506773 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-50766ed7-e159-44b7-be4a-38681a19421d tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:37.532859 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-50766ed7-e159-44b7-be4a-38681a19421d tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:37.539066 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-50766ed7-e159-44b7-be4a-38681a19421d tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:37.544196 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-50766ed7-e159-44b7-be4a-38681a19421d tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:37.903138 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-a5157e81-0637-4647-9908-e3f69cb8ce69 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:46:37.913316 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-a5157e81-0637-4647-9908-e3f69cb8ce69 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:46:37.930115 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-a5157e81-0637-4647-9908-e3f69cb8ce69 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:46:37.937254 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-a5157e81-0637-4647-9908-e3f69cb8ce69 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1281 microversion: 2.20 time: 0.665595 Jul 21 10:46:37.940826 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 15/40] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:46:37 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1281 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:46:38.054597 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-50766ed7-e159-44b7-be4a-38681a19421d tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:46:38.100563 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-50766ed7-e159-44b7-be4a-38681a19421d tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44" status: 200 len: 1225 microversion: 2.1 time: 0.651713 Jul 21 10:46:38.101167 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 26/41] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:46:37 2022] GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44 => generated 1225 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:46:38.439876 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-2a498b44-3c9a-4d0d-8a20-19bd864dcfca tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:46:38.440981 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-2a498b44-3c9a-4d0d-8a20-19bd864dcfca tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] [instance: 2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:46:38.452116 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2a498b44-3c9a-4d0d-8a20-19bd864dcfca tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:38.455033 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2a498b44-3c9a-4d0d-8a20-19bd864dcfca tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:38.457431 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2a498b44-3c9a-4d0d-8a20-19bd864dcfca tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:38.458713 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2a498b44-3c9a-4d0d-8a20-19bd864dcfca tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:38.964485 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-12b96275-397a-4be2-92bf-21b499740a5e tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:46:38.966488 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-12b96275-397a-4be2-92bf-21b499740a5e tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:46:38.973809 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-12b96275-397a-4be2-92bf-21b499740a5e tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:38.975039 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-12b96275-397a-4be2-92bf-21b499740a5e tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:38.979522 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-12b96275-397a-4be2-92bf-21b499740a5e tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:38.980250 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-12b96275-397a-4be2-92bf-21b499740a5e tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:39.085375 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-2a498b44-3c9a-4d0d-8a20-19bd864dcfca tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7606b56fec4723b733f838ec34a17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceeabe5ea2a4a24b28901f50be5d532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:46:39.123138 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-2a498b44-3c9a-4d0d-8a20-19bd864dcfca tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] 10.222.0.48 "GET /compute/v2.1/servers/2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985" status: 200 len: 1272 microversion: 2.1 time: 0.680764 Jul 21 10:46:39.126888 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 16/42] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:46:38 2022] GET /compute/v2.1/servers/2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985 => generated 1272 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:46:39.141011 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-d5793be4-6151-43ce-a103-ef454ac3af8d tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:46:39.146241 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-d5793be4-6151-43ce-a103-ef454ac3af8d tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: 86715109-fd38-41f4-b384-a319c310fc44] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:46:39.171276 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d5793be4-6151-43ce-a103-ef454ac3af8d tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:39.174255 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d5793be4-6151-43ce-a103-ef454ac3af8d tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:39.178329 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d5793be4-6151-43ce-a103-ef454ac3af8d tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:39.180053 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d5793be4-6151-43ce-a103-ef454ac3af8d tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:39.246156 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-12b96275-397a-4be2-92bf-21b499740a5e tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:46:39.286135 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-12b96275-397a-4be2-92bf-21b499740a5e tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:46:39.296949 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-12b96275-397a-4be2-92bf-21b499740a5e tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:46:39.300496 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-12b96275-397a-4be2-92bf-21b499740a5e tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1333 microversion: 2.20 time: 0.339970 Jul 21 10:46:39.302352 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 27/43] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:46:38 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1333 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:46:39.451113 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-d5793be4-6151-43ce-a103-ef454ac3af8d tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:46:39.463101 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-d5793be4-6151-43ce-a103-ef454ac3af8d tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44" status: 200 len: 1273 microversion: 2.1 time: 0.334985 Jul 21 10:46:39.466031 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 17/44] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:46:39 2022] GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44 => generated 1273 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:46:40.144447 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-a839202a-b87c-467e-b36e-31ab890f1760 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:46:40.145209 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-a839202a-b87c-467e-b36e-31ab890f1760 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] [instance: 2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:46:40.158116 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a839202a-b87c-467e-b36e-31ab890f1760 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:40.158116 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a839202a-b87c-467e-b36e-31ab890f1760 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:40.162579 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a839202a-b87c-467e-b36e-31ab890f1760 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:40.167682 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a839202a-b87c-467e-b36e-31ab890f1760 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:40.324033 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-4cfe5b5a-a4c4-480c-80f6-84c348021ded tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:46:40.324033 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-4cfe5b5a-a4c4-480c-80f6-84c348021ded tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:46:40.330983 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-4cfe5b5a-a4c4-480c-80f6-84c348021ded tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:40.332667 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-4cfe5b5a-a4c4-480c-80f6-84c348021ded tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:40.335660 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-4cfe5b5a-a4c4-480c-80f6-84c348021ded tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:40.336262 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-4cfe5b5a-a4c4-480c-80f6-84c348021ded tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:40.779862 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-4cfe5b5a-a4c4-480c-80f6-84c348021ded tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:46:40.793670 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-a839202a-b87c-467e-b36e-31ab890f1760 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7606b56fec4723b733f838ec34a17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceeabe5ea2a4a24b28901f50be5d532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:46:40.808272 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-4cfe5b5a-a4c4-480c-80f6-84c348021ded tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:46:40.810027 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-a839202a-b87c-467e-b36e-31ab890f1760 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] 10.222.0.48 "GET /compute/v2.1/servers/2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985" status: 200 len: 1272 microversion: 2.1 time: 0.669271 Jul 21 10:46:40.810963 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 28/45] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:46:40 2022] GET /compute/v2.1/servers/2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985 => generated 1272 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:46:40.825794 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-4cfe5b5a-a4c4-480c-80f6-84c348021ded tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:46:40.835346 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-4cfe5b5a-a4c4-480c-80f6-84c348021ded tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1341 microversion: 2.20 time: 0.521077 Jul 21 10:46:40.842394 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-5c4ff9a5-24f2-4fe7-8a5e-f06d320a62c1 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:46:40.843517 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 18/46] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:46:40 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1341 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 10:46:40.845035 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-5c4ff9a5-24f2-4fe7-8a5e-f06d320a62c1 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: 86715109-fd38-41f4-b384-a319c310fc44] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:46:40.861403 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5c4ff9a5-24f2-4fe7-8a5e-f06d320a62c1 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:40.861833 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5c4ff9a5-24f2-4fe7-8a5e-f06d320a62c1 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:40.867540 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5c4ff9a5-24f2-4fe7-8a5e-f06d320a62c1 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:40.867540 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5c4ff9a5-24f2-4fe7-8a5e-f06d320a62c1 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:41.066819 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-5c4ff9a5-24f2-4fe7-8a5e-f06d320a62c1 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:46:41.081782 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-5c4ff9a5-24f2-4fe7-8a5e-f06d320a62c1 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44" status: 200 len: 1279 microversion: 2.1 time: 0.257608 Jul 21 10:46:41.082298 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 29/47] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:46:40 2022] GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44 => generated 1279 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:46:41.827728 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-c503eea4-65d7-4c60-82d3-0bd65666c9d0 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:46:41.828378 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-c503eea4-65d7-4c60-82d3-0bd65666c9d0 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] [instance: 2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:46:41.863406 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-3dbf4a1a-55af-4cd4-bb41-3d9bc9843883 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:46:41.864560 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-3dbf4a1a-55af-4cd4-bb41-3d9bc9843883 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:46:41.870029 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c503eea4-65d7-4c60-82d3-0bd65666c9d0 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:41.870911 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c503eea4-65d7-4c60-82d3-0bd65666c9d0 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:41.873102 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c503eea4-65d7-4c60-82d3-0bd65666c9d0 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:41.873547 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c503eea4-65d7-4c60-82d3-0bd65666c9d0 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:41.897082 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3dbf4a1a-55af-4cd4-bb41-3d9bc9843883 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:41.897526 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3dbf4a1a-55af-4cd4-bb41-3d9bc9843883 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:41.918351 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3dbf4a1a-55af-4cd4-bb41-3d9bc9843883 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:41.922368 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3dbf4a1a-55af-4cd4-bb41-3d9bc9843883 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:42.346680 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-3dbf4a1a-55af-4cd4-bb41-3d9bc9843883 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:46:42.356559 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-3dbf4a1a-55af-4cd4-bb41-3d9bc9843883 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:46:42.358304 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-3dbf4a1a-55af-4cd4-bb41-3d9bc9843883 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:46:42.364021 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-3dbf4a1a-55af-4cd4-bb41-3d9bc9843883 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1339 microversion: 2.20 time: 0.504718 Jul 21 10:46:42.365104 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 30/48] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:46:41 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1339 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 10:46:42.379721 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-468cb305-521a-4d08-b094-392b3bd3a708 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:46:42.380344 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-468cb305-521a-4d08-b094-392b3bd3a708 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: 86715109-fd38-41f4-b384-a319c310fc44] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:46:42.390163 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-468cb305-521a-4d08-b094-392b3bd3a708 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:42.390779 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-468cb305-521a-4d08-b094-392b3bd3a708 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:42.391774 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-468cb305-521a-4d08-b094-392b3bd3a708 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:42.393243 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-468cb305-521a-4d08-b094-392b3bd3a708 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:42.555934 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-468cb305-521a-4d08-b094-392b3bd3a708 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:46:42.566392 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-468cb305-521a-4d08-b094-392b3bd3a708 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44" status: 200 len: 1279 microversion: 2.1 time: 0.199951 Jul 21 10:46:42.577361 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 31/49] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:46:42 2022] GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44 => generated 1279 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:46:42.721711 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-c503eea4-65d7-4c60-82d3-0bd65666c9d0 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7606b56fec4723b733f838ec34a17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceeabe5ea2a4a24b28901f50be5d532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:46:42.745137 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-c503eea4-65d7-4c60-82d3-0bd65666c9d0 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] 10.222.0.48 "GET /compute/v2.1/servers/2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985" status: 200 len: 1314 microversion: 2.1 time: 0.919014 Jul 21 10:46:42.746702 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 19/50] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:46:41 2022] GET /compute/v2.1/servers/2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985 => generated 1314 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:46:43.392928 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-a699a4e4-3c37-49ae-92db-4ea2677872e5 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:46:43.393455 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-a699a4e4-3c37-49ae-92db-4ea2677872e5 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:46:43.401692 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a699a4e4-3c37-49ae-92db-4ea2677872e5 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:43.402451 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a699a4e4-3c37-49ae-92db-4ea2677872e5 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:43.403605 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a699a4e4-3c37-49ae-92db-4ea2677872e5 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:43.404370 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a699a4e4-3c37-49ae-92db-4ea2677872e5 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:43.583315 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-2ca7ac2a-3558-40b2-9330-d2801381981c tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:46:43.583940 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-2ca7ac2a-3558-40b2-9330-d2801381981c tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: 86715109-fd38-41f4-b384-a319c310fc44] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:46:43.596937 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2ca7ac2a-3558-40b2-9330-d2801381981c tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:43.597498 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2ca7ac2a-3558-40b2-9330-d2801381981c tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:43.598285 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2ca7ac2a-3558-40b2-9330-d2801381981c tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:43.598781 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2ca7ac2a-3558-40b2-9330-d2801381981c tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:43.714404 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-a699a4e4-3c37-49ae-92db-4ea2677872e5 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:46:43.724855 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-a699a4e4-3c37-49ae-92db-4ea2677872e5 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:46:43.726418 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-a699a4e4-3c37-49ae-92db-4ea2677872e5 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:46:43.728453 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-a699a4e4-3c37-49ae-92db-4ea2677872e5 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1407 microversion: 2.20 time: 0.348063 Jul 21 10:46:43.730947 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 32/51] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:46:43 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1407 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:46:43.738319 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-4248c311-cae4-4b08-9e32-18c7546b7c78 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1032312693", "imageRef": "282ddb30-fa0f-489d-9cc3-a3e70e03c631", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "192d6a0f-c1f8-471a-872f-e924c6d8f479"}], "security_groups": [{"name": "tempest-securitygroup--569484618"}], "key_name": "tempest-keypair-2047653555", "user_data": "}} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:46:43.909686 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-2ca7ac2a-3558-40b2-9330-d2801381981c tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:46:43.930366 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-2ca7ac2a-3558-40b2-9330-d2801381981c tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44" status: 200 len: 1321 microversion: 2.1 time: 0.341123 Jul 21 10:46:43.930366 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 20/52] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:46:43 2022] GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44 => generated 1321 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:46:43.935442 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-23d9665c-28e2-4e45-9e99-b314ee0c68a9 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:46:43.936059 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-23d9665c-28e2-4e45-9e99-b314ee0c68a9 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] [instance: 2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:46:43.949952 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-23d9665c-28e2-4e45-9e99-b314ee0c68a9 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:43.950732 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-23d9665c-28e2-4e45-9e99-b314ee0c68a9 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:43.951709 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-23d9665c-28e2-4e45-9e99-b314ee0c68a9 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:43.952371 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-23d9665c-28e2-4e45-9e99-b314ee0c68a9 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:43.964359 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.network.neutron [None req-4248c311-cae4-4b08-9e32-18c7546b7c78 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] validate_networks() for [('192d6a0f-c1f8-471a-872f-e924c6d8f479', None, None, None, None, None)] {{(pid=124868) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 10:46:44.409960 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-23d9665c-28e2-4e45-9e99-b314ee0c68a9 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7606b56fec4723b733f838ec34a17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceeabe5ea2a4a24b28901f50be5d532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:46:44.421697 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-23d9665c-28e2-4e45-9e99-b314ee0c68a9 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] 10.222.0.48 "GET /compute/v2.1/servers/2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985" status: 200 len: 1314 microversion: 2.1 time: 0.499243 Jul 21 10:46:44.422278 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 21/53] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:46:43 2022] GET /compute/v2.1/servers/2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985 => generated 1314 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:46:44.627948 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [req-225a2191-3958-4170-933f-62885c3cfbad req-477cc028-8c44-4bc0-8811-0f217c164506 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985", "tag": "606e38eb-2f20-4811-87d6-bf2ef650eb71"}]} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:46:44.646158 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-225a2191-3958-4170-933f-62885c3cfbad req-477cc028-8c44-4bc0-8811-0f217c164506 service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:44.647087 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-225a2191-3958-4170-933f-62885c3cfbad req-477cc028-8c44-4bc0-8811-0f217c164506 service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:44.668037 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.compute.server_external_events [req-225a2191-3958-4170-933f-62885c3cfbad req-477cc028-8c44-4bc0-8811-0f217c164506 service nova] Creating event network-changed:606e38eb-2f20-4811-87d6-bf2ef650eb71 for instance 2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985 on hv-cinder-84980 Jul 21 10:46:44.669012 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-225a2191-3958-4170-933f-62885c3cfbad req-477cc028-8c44-4bc0-8811-0f217c164506 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124867) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 21 10:46:44.670126 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-03a00a76-67d7-43e2-b6ad-92726c8a417b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:44.670918 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-03a00a76-67d7-43e2-b6ad-92726c8a417b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:44.671774 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-03a00a76-67d7-43e2-b6ad-92726c8a417b None None] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:44.672911 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-03a00a76-67d7-43e2-b6ad-92726c8a417b None None] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:44.684233 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.compute.rpcapi [None req-03a00a76-67d7-43e2-b6ad-92726c8a417b None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 21 10:46:44.702960 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-03a00a76-67d7-43e2-b6ad-92726c8a417b None None] Releasing lock "compute-rpcapi-router" {{(pid=124867) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 21 10:46:44.709399 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-03a00a76-67d7-43e2-b6ad-92726c8a417b None None] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.285693 Jul 21 10:46:44.710001 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 22/54] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 21 10:46:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:46:44.749880 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-eb4c389b-6446-4fd5-b340-87be267bc2cb tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:46:44.754792 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-eb4c389b-6446-4fd5-b340-87be267bc2cb tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:46:44.758291 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-eb4c389b-6446-4fd5-b340-87be267bc2cb tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:44.760031 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-eb4c389b-6446-4fd5-b340-87be267bc2cb tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:44.763436 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.virt.hardware [None req-4248c311-cae4-4b08-9e32-18c7546b7c78 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Flavor limits 0:0:0 {{(pid=124868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 10:46:44.764373 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.virt.hardware [None req-4248c311-cae4-4b08-9e32-18c7546b7c78 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Image limits 0:0:0 {{(pid=124868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 10:46:44.764841 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.virt.hardware [None req-4248c311-cae4-4b08-9e32-18c7546b7c78 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Flavor pref 0:0:0 {{(pid=124868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 10:46:44.765399 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.virt.hardware [None req-4248c311-cae4-4b08-9e32-18c7546b7c78 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Image pref 0:0:0 {{(pid=124868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 10:46:44.765805 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.virt.hardware [None req-4248c311-cae4-4b08-9e32-18c7546b7c78 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 10:46:44.769492 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-eb4c389b-6446-4fd5-b340-87be267bc2cb tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:44.770011 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-eb4c389b-6446-4fd5-b340-87be267bc2cb tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:44.778528 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4248c311-cae4-4b08-9e32-18c7546b7c78 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:44.779518 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4248c311-cae4-4b08-9e32-18c7546b7c78 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:44.780518 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4248c311-cae4-4b08-9e32-18c7546b7c78 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:44.781124 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4248c311-cae4-4b08-9e32-18c7546b7c78 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:44.829531 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.quota [None req-4248c311-cae4-4b08-9e32-18c7546b7c78 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Getting quotas for project 0dc215aadb5345d791945658832aae4a. Resources: {'ram', 'instances', 'cores'} {{(pid=124868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 10:46:44.834119 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.quota [None req-4248c311-cae4-4b08-9e32-18c7546b7c78 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Getting quotas for user 906e4bc4e9cc45ecb01cfca7918e461d and project 0dc215aadb5345d791945658832aae4a. Resources: {'ram', 'instances', 'cores'} {{(pid=124868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 10:46:44.850974 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-4248c311-cae4-4b08-9e32-18c7546b7c78 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Going to run 1 instances... {{(pid=124868) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 10:46:44.854147 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-4248c311-cae4-4b08-9e32-18c7546b7c78 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 691ae8fc-92e7-4940-99d8-7edb5a96d2f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='282ddb30-fa0f-489d-9cc3-a3e70e03c631',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 10:46:45.026569 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-eb4c389b-6446-4fd5-b340-87be267bc2cb tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:46:45.042147 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-eb4c389b-6446-4fd5-b340-87be267bc2cb tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:46:45.044234 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-eb4c389b-6446-4fd5-b340-87be267bc2cb tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:46:45.048996 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-eb4c389b-6446-4fd5-b340-87be267bc2cb tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1407 microversion: 2.20 time: 0.302706 Jul 21 10:46:45.048996 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 23/55] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:46:44 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1407 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:46:45.051770 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-475872ec-a700-4da0-b688-61e55395fc0e tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:46:45.052700 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-475872ec-a700-4da0-b688-61e55395fc0e tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: 86715109-fd38-41f4-b384-a319c310fc44] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:46:45.061393 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-475872ec-a700-4da0-b688-61e55395fc0e tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:45.062833 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-475872ec-a700-4da0-b688-61e55395fc0e tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:45.064877 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-475872ec-a700-4da0-b688-61e55395fc0e tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:45.075144 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-4248c311-cae4-4b08-9e32-18c7546b7c78 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.342664 Jul 21 10:46:45.078372 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 33/56] 10.222.0.48 () {60 vars in 1146 bytes} [Thu Jul 21 10:46:43 2022] POST /compute/v2.1/servers => generated 401 bytes in 1344 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 10:46:45.088081 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-b67e752d-307b-47f0-83f9-c60b0936cd27 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:46:45.089153 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-b67e752d-307b-47f0-83f9-c60b0936cd27 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 691ae8fc-92e7-4940-99d8-7edb5a96d2f3] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:46:45.096042 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-475872ec-a700-4da0-b688-61e55395fc0e tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:45.284011 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-b67e752d-307b-47f0-83f9-c60b0936cd27 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906e4bc4e9cc45ecb01cfca7918e461d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc215aadb5345d791945658832aae4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:46:45.292792 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-b67e752d-307b-47f0-83f9-c60b0936cd27 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/691ae8fc-92e7-4940-99d8-7edb5a96d2f3" status: 200 len: 1242 microversion: 2.1 time: 0.208655 Jul 21 10:46:45.298852 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 34/57] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:46:45 2022] GET /compute/v2.1/servers/691ae8fc-92e7-4940-99d8-7edb5a96d2f3 => generated 1242 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:46:45.439705 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-e122abce-18b3-4e9e-8dcd-6a01ab147760 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:46:45.440587 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-e122abce-18b3-4e9e-8dcd-6a01ab147760 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] [instance: 2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:46:45.453533 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e122abce-18b3-4e9e-8dcd-6a01ab147760 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:45.454229 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e122abce-18b3-4e9e-8dcd-6a01ab147760 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:45.455911 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e122abce-18b3-4e9e-8dcd-6a01ab147760 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:45.458070 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e122abce-18b3-4e9e-8dcd-6a01ab147760 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:46.314510 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-e122abce-18b3-4e9e-8dcd-6a01ab147760 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7606b56fec4723b733f838ec34a17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceeabe5ea2a4a24b28901f50be5d532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:46:46.329538 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-e122abce-18b3-4e9e-8dcd-6a01ab147760 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] 10.222.0.48 "GET /compute/v2.1/servers/2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985" status: 200 len: 1314 microversion: 2.1 time: 0.893238 Jul 21 10:46:46.356927 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 35/58] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:46:45 2022] GET /compute/v2.1/servers/2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985 => generated 1314 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:46:46.370584 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-b7073099-250f-4aa1-b779-8c304cfe37e0 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:46:46.372654 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-b7073099-250f-4aa1-b779-8c304cfe37e0 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:46:46.386853 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b7073099-250f-4aa1-b779-8c304cfe37e0 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:46.387639 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b7073099-250f-4aa1-b779-8c304cfe37e0 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:46.396245 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b7073099-250f-4aa1-b779-8c304cfe37e0 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:46.397009 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b7073099-250f-4aa1-b779-8c304cfe37e0 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:46.976997 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-475872ec-a700-4da0-b688-61e55395fc0e tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:46:46.988785 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-475872ec-a700-4da0-b688-61e55395fc0e tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44" status: 200 len: 1321 microversion: 2.1 time: 1.941357 Jul 21 10:46:46.996193 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 24/59] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:46:45 2022] GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44 => generated 1321 bytes in 1949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:46:47.001335 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-6cc7ce69-2e67-430f-b151-0c7bea1c79b0 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:46:47.012240 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-6cc7ce69-2e67-430f-b151-0c7bea1c79b0 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 691ae8fc-92e7-4940-99d8-7edb5a96d2f3] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:46:47.237021 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-6cc7ce69-2e67-430f-b151-0c7bea1c79b0 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906e4bc4e9cc45ecb01cfca7918e461d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc215aadb5345d791945658832aae4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:46:47.246215 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-6cc7ce69-2e67-430f-b151-0c7bea1c79b0 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/691ae8fc-92e7-4940-99d8-7edb5a96d2f3" status: 200 len: 1242 microversion: 2.1 time: 0.248725 Jul 21 10:46:47.248996 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 25/60] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:46:46 2022] GET /compute/v2.1/servers/691ae8fc-92e7-4940-99d8-7edb5a96d2f3 => generated 1242 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:46:47.267149 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-b7073099-250f-4aa1-b779-8c304cfe37e0 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:46:47.296783 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-b7073099-250f-4aa1-b779-8c304cfe37e0 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:46:47.305546 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-b7073099-250f-4aa1-b779-8c304cfe37e0 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:46:47.306760 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-b7073099-250f-4aa1-b779-8c304cfe37e0 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1407 microversion: 2.20 time: 0.947940 Jul 21 10:46:47.312758 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 36/61] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:46:46 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1407 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:46:47.359215 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-317c0201-83f7-480a-8864-2ce8a65eb99d tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:46:47.360077 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-317c0201-83f7-480a-8864-2ce8a65eb99d tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] [instance: 2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:46:47.370084 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-317c0201-83f7-480a-8864-2ce8a65eb99d tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:47.375287 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-317c0201-83f7-480a-8864-2ce8a65eb99d tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:47.376353 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-317c0201-83f7-480a-8864-2ce8a65eb99d tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:47.376822 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-317c0201-83f7-480a-8864-2ce8a65eb99d tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:47.844709 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-317c0201-83f7-480a-8864-2ce8a65eb99d tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7606b56fec4723b733f838ec34a17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceeabe5ea2a4a24b28901f50be5d532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:46:47.851631 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-317c0201-83f7-480a-8864-2ce8a65eb99d tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] 10.222.0.48 "GET /compute/v2.1/servers/2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985" status: 200 len: 1314 microversion: 2.1 time: 0.494586 Jul 21 10:46:47.854989 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 26/62] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:46:47 2022] GET /compute/v2.1/servers/2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985 => generated 1314 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:46:48.005447 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-d7bd572f-1398-4d68-82a1-17a9cd185409 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:46:48.006129 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-d7bd572f-1398-4d68-82a1-17a9cd185409 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: 86715109-fd38-41f4-b384-a319c310fc44] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:46:48.019513 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d7bd572f-1398-4d68-82a1-17a9cd185409 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:48.019968 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d7bd572f-1398-4d68-82a1-17a9cd185409 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:48.020757 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d7bd572f-1398-4d68-82a1-17a9cd185409 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:48.032447 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d7bd572f-1398-4d68-82a1-17a9cd185409 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:48.107976 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [req-e83d8761-5ebe-4932-821a-56cde69a724d req-60d58813-033d-49be-bf7c-7b6b562b2a62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7a76827-1907-4bf4-b27c-945b33b2316d", "tag": "19e030a0-d846-4c1c-bab7-3d45644c2248"}]} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:46:48.131012 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-e83d8761-5ebe-4932-821a-56cde69a724d req-60d58813-033d-49be-bf7c-7b6b562b2a62 service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:48.131725 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-e83d8761-5ebe-4932-821a-56cde69a724d req-60d58813-033d-49be-bf7c-7b6b562b2a62 service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:48.155432 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.compute.server_external_events [req-e83d8761-5ebe-4932-821a-56cde69a724d req-60d58813-033d-49be-bf7c-7b6b562b2a62 service nova] Creating event network-changed:19e030a0-d846-4c1c-bab7-3d45644c2248 for instance b7a76827-1907-4bf4-b27c-945b33b2316d on hv-cinder-84980 Jul 21 10:46:48.156358 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-e83d8761-5ebe-4932-821a-56cde69a724d req-60d58813-033d-49be-bf7c-7b6b562b2a62 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124868) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 21 10:46:48.158021 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7d019597-ac4a-477d-acce-1eeadb6de6f5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:48.158686 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7d019597-ac4a-477d-acce-1eeadb6de6f5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:48.159638 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7d019597-ac4a-477d-acce-1eeadb6de6f5 None None] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:48.168330 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7d019597-ac4a-477d-acce-1eeadb6de6f5 None None] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:48.179629 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.compute.rpcapi [None req-7d019597-ac4a-477d-acce-1eeadb6de6f5 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 21 10:46:48.180967 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7d019597-ac4a-477d-acce-1eeadb6de6f5 None None] Releasing lock "compute-rpcapi-router" {{(pid=124868) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 21 10:46:48.206252 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-7d019597-ac4a-477d-acce-1eeadb6de6f5 None None] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.255826 Jul 21 10:46:48.207565 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 37/63] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 21 10:46:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:46:48.266754 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-2017c863-fac3-4801-976b-60fb1dcaadad tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:46:48.274838 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-2017c863-fac3-4801-976b-60fb1dcaadad tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 691ae8fc-92e7-4940-99d8-7edb5a96d2f3] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:46:48.277881 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-2017c863-fac3-4801-976b-60fb1dcaadad tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:48.278329 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-2017c863-fac3-4801-976b-60fb1dcaadad tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:48.284800 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-2017c863-fac3-4801-976b-60fb1dcaadad tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:48.287473 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-2017c863-fac3-4801-976b-60fb1dcaadad tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:48.432636 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-d7bd572f-1398-4d68-82a1-17a9cd185409 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:46:48.443566 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-d7bd572f-1398-4d68-82a1-17a9cd185409 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44" status: 200 len: 1321 microversion: 2.1 time: 0.441575 Jul 21 10:46:48.444650 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 27/64] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:46:48 2022] GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44 => generated 1321 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:46:48.448103 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-2017c863-fac3-4801-976b-60fb1dcaadad tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906e4bc4e9cc45ecb01cfca7918e461d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc215aadb5345d791945658832aae4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:46:48.457935 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-04f6146b-52cf-4c76-8f73-5e9d3c19b36d tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:46:48.458925 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-04f6146b-52cf-4c76-8f73-5e9d3c19b36d tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:46:48.473481 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-04f6146b-52cf-4c76-8f73-5e9d3c19b36d tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:48.473481 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-04f6146b-52cf-4c76-8f73-5e9d3c19b36d tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:48.473481 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-04f6146b-52cf-4c76-8f73-5e9d3c19b36d tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:48.473481 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-04f6146b-52cf-4c76-8f73-5e9d3c19b36d tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:48.495383 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-2017c863-fac3-4801-976b-60fb1dcaadad tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/691ae8fc-92e7-4940-99d8-7edb5a96d2f3" status: 200 len: 1246 microversion: 2.1 time: 0.227839 Jul 21 10:46:48.496055 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 38/65] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:46:48 2022] GET /compute/v2.1/servers/691ae8fc-92e7-4940-99d8-7edb5a96d2f3 => generated 1246 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:46:48.873663 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-e91911c8-2cec-427d-8bf5-05a7d5db3b67 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:46:48.874357 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-e91911c8-2cec-427d-8bf5-05a7d5db3b67 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] [instance: 2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:46:48.880682 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e91911c8-2cec-427d-8bf5-05a7d5db3b67 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:48.881527 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e91911c8-2cec-427d-8bf5-05a7d5db3b67 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:48.882434 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e91911c8-2cec-427d-8bf5-05a7d5db3b67 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:48.883211 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e91911c8-2cec-427d-8bf5-05a7d5db3b67 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:48.904776 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-04f6146b-52cf-4c76-8f73-5e9d3c19b36d tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:46:48.914176 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-04f6146b-52cf-4c76-8f73-5e9d3c19b36d tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:46:48.918589 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-04f6146b-52cf-4c76-8f73-5e9d3c19b36d tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:46:48.919706 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-04f6146b-52cf-4c76-8f73-5e9d3c19b36d tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1407 microversion: 2.20 time: 0.473934 Jul 21 10:46:48.920269 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 28/66] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:46:48 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1407 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:46:48.934285 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [req-0bcb6e74-d6a6-4f0b-962d-4d5fda49789c req-60f82c83-84e2-446b-a389-78e764d69334 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e730525-7ce4-4a5a-8023-84cae6b1da3d", "tag": "e0efd748-6569-4435-ab16-d9acccb72164"}]} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:46:48.946764 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-0bcb6e74-d6a6-4f0b-962d-4d5fda49789c req-60f82c83-84e2-446b-a389-78e764d69334 service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:48.947640 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-0bcb6e74-d6a6-4f0b-962d-4d5fda49789c req-60f82c83-84e2-446b-a389-78e764d69334 service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:48.964110 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.compute.server_external_events [req-0bcb6e74-d6a6-4f0b-962d-4d5fda49789c req-60f82c83-84e2-446b-a389-78e764d69334 service nova] Creating event network-changed:e0efd748-6569-4435-ab16-d9acccb72164 for instance 1e730525-7ce4-4a5a-8023-84cae6b1da3d on hv-cinder-84980 Jul 21 10:46:48.969196 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [req-0bcb6e74-d6a6-4f0b-962d-4d5fda49789c req-60f82c83-84e2-446b-a389-78e764d69334 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044305 Jul 21 10:46:48.970194 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 29/67] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 21 10:46:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:46:49.060469 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-e91911c8-2cec-427d-8bf5-05a7d5db3b67 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7606b56fec4723b733f838ec34a17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceeabe5ea2a4a24b28901f50be5d532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:46:49.068242 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-e91911c8-2cec-427d-8bf5-05a7d5db3b67 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] 10.222.0.48 "GET /compute/v2.1/servers/2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985" status: 200 len: 1314 microversion: 2.1 time: 0.200234 Jul 21 10:46:49.068830 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 39/68] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:46:48 2022] GET /compute/v2.1/servers/2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985 => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:46:49.461359 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-62c29304-5f78-40cd-9e92-ae15111f81ac tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:46:49.462465 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-62c29304-5f78-40cd-9e92-ae15111f81ac tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: 86715109-fd38-41f4-b384-a319c310fc44] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:46:49.468193 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-62c29304-5f78-40cd-9e92-ae15111f81ac tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:49.468632 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-62c29304-5f78-40cd-9e92-ae15111f81ac tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:49.469376 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-62c29304-5f78-40cd-9e92-ae15111f81ac tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:49.469805 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-62c29304-5f78-40cd-9e92-ae15111f81ac tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:49.517611 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-bd645271-ff5f-435a-a3ef-ee16ecf48c67 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:46:49.518855 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-bd645271-ff5f-435a-a3ef-ee16ecf48c67 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 691ae8fc-92e7-4940-99d8-7edb5a96d2f3] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:46:49.528108 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-bd645271-ff5f-435a-a3ef-ee16ecf48c67 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:49.528657 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-bd645271-ff5f-435a-a3ef-ee16ecf48c67 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:49.529694 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-bd645271-ff5f-435a-a3ef-ee16ecf48c67 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:49.530221 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-bd645271-ff5f-435a-a3ef-ee16ecf48c67 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:49.613238 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-bd645271-ff5f-435a-a3ef-ee16ecf48c67 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906e4bc4e9cc45ecb01cfca7918e461d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc215aadb5345d791945658832aae4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:46:49.637899 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-bd645271-ff5f-435a-a3ef-ee16ecf48c67 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/691ae8fc-92e7-4940-99d8-7edb5a96d2f3" status: 200 len: 1246 microversion: 2.1 time: 0.119676 Jul 21 10:46:49.641020 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-62c29304-5f78-40cd-9e92-ae15111f81ac tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:46:49.649656 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 40/69] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:46:49 2022] GET /compute/v2.1/servers/691ae8fc-92e7-4940-99d8-7edb5a96d2f3 => generated 1246 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:46:49.649956 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-62c29304-5f78-40cd-9e92-ae15111f81ac tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44" status: 200 len: 1321 microversion: 2.1 time: 0.192624 Jul 21 10:46:49.654803 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 30/70] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:46:49 2022] GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44 => generated 1321 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:46:49.937725 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-524792f2-17a5-4b7e-9704-3e305dc035da tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:46:49.938332 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-524792f2-17a5-4b7e-9704-3e305dc035da tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:46:49.944534 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-524792f2-17a5-4b7e-9704-3e305dc035da tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:49.945926 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-524792f2-17a5-4b7e-9704-3e305dc035da tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:49.945926 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-524792f2-17a5-4b7e-9704-3e305dc035da tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:49.946313 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-524792f2-17a5-4b7e-9704-3e305dc035da tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:50.085598 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-68baeb0c-4cd0-4b15-8781-9d45ca2c8f6e tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:46:50.087049 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-68baeb0c-4cd0-4b15-8781-9d45ca2c8f6e tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] [instance: 2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:46:50.093763 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-68baeb0c-4cd0-4b15-8781-9d45ca2c8f6e tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:50.094212 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-68baeb0c-4cd0-4b15-8781-9d45ca2c8f6e tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:50.095251 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-68baeb0c-4cd0-4b15-8781-9d45ca2c8f6e tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:50.095685 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-68baeb0c-4cd0-4b15-8781-9d45ca2c8f6e tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:50.128684 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-524792f2-17a5-4b7e-9704-3e305dc035da tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:46:50.135479 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell1:SELECT=100 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:46:50.141231 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-524792f2-17a5-4b7e-9704-3e305dc035da tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:46:50.142950 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-524792f2-17a5-4b7e-9704-3e305dc035da tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:46:50.144226 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-524792f2-17a5-4b7e-9704-3e305dc035da tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1407 microversion: 2.20 time: 0.210416 Jul 21 10:46:50.145306 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 41/71] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:46:49 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1407 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:46:50.244497 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [req-2fb404fd-095e-496b-be05-afe0f212cf24 req-a86a983d-54b3-46cd-afee-d2e1bde3ea8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86715109-fd38-41f4-b384-a319c310fc44", "tag": "2f00b65f-1c5b-4127-be24-1cea853f5f63"}]} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:46:50.255552 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-2fb404fd-095e-496b-be05-afe0f212cf24 req-a86a983d-54b3-46cd-afee-d2e1bde3ea8e service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:50.256155 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-2fb404fd-095e-496b-be05-afe0f212cf24 req-a86a983d-54b3-46cd-afee-d2e1bde3ea8e service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:50.285183 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.compute.server_external_events [req-2fb404fd-095e-496b-be05-afe0f212cf24 req-a86a983d-54b3-46cd-afee-d2e1bde3ea8e service nova] Creating event network-changed:2f00b65f-1c5b-4127-be24-1cea853f5f63 for instance 86715109-fd38-41f4-b384-a319c310fc44 on hv-cinder-84980 Jul 21 10:46:50.289259 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-68baeb0c-4cd0-4b15-8781-9d45ca2c8f6e tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7606b56fec4723b733f838ec34a17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceeabe5ea2a4a24b28901f50be5d532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:46:50.293139 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [req-2fb404fd-095e-496b-be05-afe0f212cf24 req-a86a983d-54b3-46cd-afee-d2e1bde3ea8e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052792 Jul 21 10:46:50.298259 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 42/72] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 21 10:46:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 10:46:50.310745 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-68baeb0c-4cd0-4b15-8781-9d45ca2c8f6e tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] 10.222.0.48 "GET /compute/v2.1/servers/2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985" status: 200 len: 1314 microversion: 2.1 time: 0.229082 Jul 21 10:46:50.312115 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 31/73] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:46:50 2022] GET /compute/v2.1/servers/2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985 => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:46:50.656500 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-baa7927e-611f-4767-99a0-0ffad0bd1c90 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:46:50.657207 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-baa7927e-611f-4767-99a0-0ffad0bd1c90 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 691ae8fc-92e7-4940-99d8-7edb5a96d2f3] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:46:50.660972 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:46:50.669638 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-baa7927e-611f-4767-99a0-0ffad0bd1c90 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:50.670684 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-baa7927e-611f-4767-99a0-0ffad0bd1c90 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:50.671939 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-baa7927e-611f-4767-99a0-0ffad0bd1c90 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:50.672608 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-baa7927e-611f-4767-99a0-0ffad0bd1c90 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:50.679368 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-24de34d9-ea23-45c7-a8f0-9be50287f25f tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:46:50.681123 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-24de34d9-ea23-45c7-a8f0-9be50287f25f tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: 86715109-fd38-41f4-b384-a319c310fc44] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:46:50.687410 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:46:50.695513 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-24de34d9-ea23-45c7-a8f0-9be50287f25f tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:50.695513 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-24de34d9-ea23-45c7-a8f0-9be50287f25f tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:50.695513 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-24de34d9-ea23-45c7-a8f0-9be50287f25f tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:50.695513 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-24de34d9-ea23-45c7-a8f0-9be50287f25f tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:50.893659 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-baa7927e-611f-4767-99a0-0ffad0bd1c90 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906e4bc4e9cc45ecb01cfca7918e461d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc215aadb5345d791945658832aae4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:46:50.904676 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-baa7927e-611f-4767-99a0-0ffad0bd1c90 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/691ae8fc-92e7-4940-99d8-7edb5a96d2f3" status: 200 len: 1246 microversion: 2.1 time: 0.252130 Jul 21 10:46:50.905184 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 43/74] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:46:50 2022] GET /compute/v2.1/servers/691ae8fc-92e7-4940-99d8-7edb5a96d2f3 => generated 1246 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:46:50.993666 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-24de34d9-ea23-45c7-a8f0-9be50287f25f tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:46:51.004407 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-24de34d9-ea23-45c7-a8f0-9be50287f25f tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44" status: 200 len: 1321 microversion: 2.1 time: 0.338347 Jul 21 10:46:51.007356 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 32/75] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:46:50 2022] GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44 => generated 1321 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:46:51.165282 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-8e9325c1-31f8-4434-abf4-2a040c791c02 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:46:51.165992 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-8e9325c1-31f8-4434-abf4-2a040c791c02 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:46:51.174296 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8e9325c1-31f8-4434-abf4-2a040c791c02 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:51.175889 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8e9325c1-31f8-4434-abf4-2a040c791c02 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:51.178184 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8e9325c1-31f8-4434-abf4-2a040c791c02 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:51.179483 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8e9325c1-31f8-4434-abf4-2a040c791c02 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:51.337347 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-b4639002-fb52-4ca7-8c00-117720ce4581 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:46:51.338501 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-b4639002-fb52-4ca7-8c00-117720ce4581 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] [instance: 2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:46:51.353667 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b4639002-fb52-4ca7-8c00-117720ce4581 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:51.354286 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b4639002-fb52-4ca7-8c00-117720ce4581 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:51.355180 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b4639002-fb52-4ca7-8c00-117720ce4581 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:51.355749 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b4639002-fb52-4ca7-8c00-117720ce4581 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:51.403985 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-8e9325c1-31f8-4434-abf4-2a040c791c02 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:46:51.424385 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-8e9325c1-31f8-4434-abf4-2a040c791c02 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:46:51.427090 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-8e9325c1-31f8-4434-abf4-2a040c791c02 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:46:51.428789 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-8e9325c1-31f8-4434-abf4-2a040c791c02 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1407 microversion: 2.20 time: 0.267773 Jul 21 10:46:51.429155 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 44/76] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:46:51 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1407 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:46:51.560963 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-b4639002-fb52-4ca7-8c00-117720ce4581 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7606b56fec4723b733f838ec34a17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceeabe5ea2a4a24b28901f50be5d532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:46:51.564393 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell1:SELECT=100 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:46:51.580908 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-b4639002-fb52-4ca7-8c00-117720ce4581 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] 10.222.0.48 "GET /compute/v2.1/servers/2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985" status: 200 len: 1314 microversion: 2.1 time: 0.243145 Jul 21 10:46:51.580908 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 33/77] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:46:51 2022] GET /compute/v2.1/servers/2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985 => generated 1314 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:46:51.923006 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-1cf8b3b7-f088-4bb0-bff2-9b238e2cc144 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:46:51.923907 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-1cf8b3b7-f088-4bb0-bff2-9b238e2cc144 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 691ae8fc-92e7-4940-99d8-7edb5a96d2f3] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:46:51.933481 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1cf8b3b7-f088-4bb0-bff2-9b238e2cc144 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:51.934057 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1cf8b3b7-f088-4bb0-bff2-9b238e2cc144 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:51.936458 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1cf8b3b7-f088-4bb0-bff2-9b238e2cc144 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:51.938683 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1cf8b3b7-f088-4bb0-bff2-9b238e2cc144 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:52.023027 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-dc0fe78f-5b4f-4778-a865-7fbb970c041e tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:46:52.030006 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-dc0fe78f-5b4f-4778-a865-7fbb970c041e tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: 86715109-fd38-41f4-b384-a319c310fc44] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:46:52.030157 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-1cf8b3b7-f088-4bb0-bff2-9b238e2cc144 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906e4bc4e9cc45ecb01cfca7918e461d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc215aadb5345d791945658832aae4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:46:52.031413 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-dc0fe78f-5b4f-4778-a865-7fbb970c041e tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:52.031875 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-dc0fe78f-5b4f-4778-a865-7fbb970c041e tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:52.032670 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-dc0fe78f-5b4f-4778-a865-7fbb970c041e tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:52.033255 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-dc0fe78f-5b4f-4778-a865-7fbb970c041e tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:52.035616 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-1cf8b3b7-f088-4bb0-bff2-9b238e2cc144 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/691ae8fc-92e7-4940-99d8-7edb5a96d2f3" status: 200 len: 1246 microversion: 2.1 time: 0.116413 Jul 21 10:46:52.036544 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 45/78] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:46:51 2022] GET /compute/v2.1/servers/691ae8fc-92e7-4940-99d8-7edb5a96d2f3 => generated 1246 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:46:52.225258 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-dc0fe78f-5b4f-4778-a865-7fbb970c041e tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:46:52.233077 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-dc0fe78f-5b4f-4778-a865-7fbb970c041e tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44" status: 200 len: 1321 microversion: 2.1 time: 0.214521 Jul 21 10:46:52.234260 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 34/79] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:46:52 2022] GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44 => generated 1321 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:46:52.456572 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-67dffd7c-1545-44aa-b336-a4ecf8a081e7 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:46:52.457507 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-67dffd7c-1545-44aa-b336-a4ecf8a081e7 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:46:52.465425 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-67dffd7c-1545-44aa-b336-a4ecf8a081e7 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:52.465919 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-67dffd7c-1545-44aa-b336-a4ecf8a081e7 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:52.466682 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-67dffd7c-1545-44aa-b336-a4ecf8a081e7 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:52.467111 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-67dffd7c-1545-44aa-b336-a4ecf8a081e7 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:52.596480 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-5dc2a59d-0260-4ad5-b520-0152523aebe6 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:46:52.597616 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-5dc2a59d-0260-4ad5-b520-0152523aebe6 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] [instance: 2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:46:52.613257 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5dc2a59d-0260-4ad5-b520-0152523aebe6 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:52.618868 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5dc2a59d-0260-4ad5-b520-0152523aebe6 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:52.619748 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5dc2a59d-0260-4ad5-b520-0152523aebe6 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:52.620199 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5dc2a59d-0260-4ad5-b520-0152523aebe6 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:52.633058 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-67dffd7c-1545-44aa-b336-a4ecf8a081e7 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:46:52.644575 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-67dffd7c-1545-44aa-b336-a4ecf8a081e7 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:46:52.646703 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-67dffd7c-1545-44aa-b336-a4ecf8a081e7 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:46:52.648360 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-67dffd7c-1545-44aa-b336-a4ecf8a081e7 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1407 microversion: 2.20 time: 0.196479 Jul 21 10:46:52.649651 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 46/80] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:46:52 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1407 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:46:52.804742 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-5dc2a59d-0260-4ad5-b520-0152523aebe6 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7606b56fec4723b733f838ec34a17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceeabe5ea2a4a24b28901f50be5d532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:46:52.814371 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-5dc2a59d-0260-4ad5-b520-0152523aebe6 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] 10.222.0.48 "GET /compute/v2.1/servers/2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985" status: 200 len: 1314 microversion: 2.1 time: 0.221607 Jul 21 10:46:52.815550 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 35/81] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:46:52 2022] GET /compute/v2.1/servers/2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985 => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:46:53.054763 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-cecf83f0-52c3-4e0d-9b64-b1739216cf40 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:46:53.056069 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-cecf83f0-52c3-4e0d-9b64-b1739216cf40 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 691ae8fc-92e7-4940-99d8-7edb5a96d2f3] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:46:53.062679 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-cecf83f0-52c3-4e0d-9b64-b1739216cf40 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:53.063128 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-cecf83f0-52c3-4e0d-9b64-b1739216cf40 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:53.063912 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-cecf83f0-52c3-4e0d-9b64-b1739216cf40 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:53.064346 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-cecf83f0-52c3-4e0d-9b64-b1739216cf40 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:53.156939 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-cecf83f0-52c3-4e0d-9b64-b1739216cf40 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906e4bc4e9cc45ecb01cfca7918e461d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc215aadb5345d791945658832aae4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:46:53.169407 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-cecf83f0-52c3-4e0d-9b64-b1739216cf40 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/691ae8fc-92e7-4940-99d8-7edb5a96d2f3" status: 200 len: 1246 microversion: 2.1 time: 0.118064 Jul 21 10:46:53.170756 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 47/82] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:46:53 2022] GET /compute/v2.1/servers/691ae8fc-92e7-4940-99d8-7edb5a96d2f3 => generated 1246 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:46:53.264035 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-b6f03772-da09-4c50-94d3-0622cc913e9e tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:46:53.264966 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-b6f03772-da09-4c50-94d3-0622cc913e9e tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: 86715109-fd38-41f4-b384-a319c310fc44] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:46:53.271478 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b6f03772-da09-4c50-94d3-0622cc913e9e tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:53.273632 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b6f03772-da09-4c50-94d3-0622cc913e9e tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:53.273632 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b6f03772-da09-4c50-94d3-0622cc913e9e tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:53.273632 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b6f03772-da09-4c50-94d3-0622cc913e9e tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:53.458851 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-b6f03772-da09-4c50-94d3-0622cc913e9e tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:46:53.467313 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-b6f03772-da09-4c50-94d3-0622cc913e9e tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44" status: 200 len: 1321 microversion: 2.1 time: 0.208552 Jul 21 10:46:53.468000 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 36/83] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:46:53 2022] GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44 => generated 1321 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:46:53.667258 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-eec111f7-8fcc-4932-b708-7171c8ce95da tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:46:53.667874 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-eec111f7-8fcc-4932-b708-7171c8ce95da tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:46:53.674251 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-eec111f7-8fcc-4932-b708-7171c8ce95da tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:53.674735 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-eec111f7-8fcc-4932-b708-7171c8ce95da tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:53.675747 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-eec111f7-8fcc-4932-b708-7171c8ce95da tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:53.676202 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-eec111f7-8fcc-4932-b708-7171c8ce95da tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:53.833327 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-3d47c645-c4b5-40a7-9e00-5f4d06bbacb4 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:46:53.833935 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-3d47c645-c4b5-40a7-9e00-5f4d06bbacb4 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] [instance: 2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:46:53.842267 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3d47c645-c4b5-40a7-9e00-5f4d06bbacb4 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:53.842267 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3d47c645-c4b5-40a7-9e00-5f4d06bbacb4 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:53.842751 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3d47c645-c4b5-40a7-9e00-5f4d06bbacb4 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:53.843444 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3d47c645-c4b5-40a7-9e00-5f4d06bbacb4 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:53.893325 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-eec111f7-8fcc-4932-b708-7171c8ce95da tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:46:53.909069 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-eec111f7-8fcc-4932-b708-7171c8ce95da tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:46:53.913273 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-eec111f7-8fcc-4932-b708-7171c8ce95da tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:46:53.920646 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-eec111f7-8fcc-4932-b708-7171c8ce95da tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1407 microversion: 2.20 time: 0.258239 Jul 21 10:46:53.933641 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 48/84] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:46:53 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1407 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:46:54.081685 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-3d47c645-c4b5-40a7-9e00-5f4d06bbacb4 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7606b56fec4723b733f838ec34a17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceeabe5ea2a4a24b28901f50be5d532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:46:54.091952 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-3d47c645-c4b5-40a7-9e00-5f4d06bbacb4 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] 10.222.0.48 "GET /compute/v2.1/servers/2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985" status: 200 len: 1314 microversion: 2.1 time: 0.262578 Jul 21 10:46:54.098155 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 37/85] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:46:53 2022] GET /compute/v2.1/servers/2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985 => generated 1314 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:46:54.199881 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-3391d585-2afb-466c-8ff7-c9e1bbbdaa72 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:46:54.201444 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-3391d585-2afb-466c-8ff7-c9e1bbbdaa72 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 691ae8fc-92e7-4940-99d8-7edb5a96d2f3] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:46:54.226806 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3391d585-2afb-466c-8ff7-c9e1bbbdaa72 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:54.228095 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3391d585-2afb-466c-8ff7-c9e1bbbdaa72 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:54.229357 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3391d585-2afb-466c-8ff7-c9e1bbbdaa72 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:54.229971 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3391d585-2afb-466c-8ff7-c9e1bbbdaa72 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:54.327072 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-3391d585-2afb-466c-8ff7-c9e1bbbdaa72 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906e4bc4e9cc45ecb01cfca7918e461d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc215aadb5345d791945658832aae4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:46:54.341718 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-3391d585-2afb-466c-8ff7-c9e1bbbdaa72 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/691ae8fc-92e7-4940-99d8-7edb5a96d2f3" status: 200 len: 1246 microversion: 2.1 time: 0.150023 Jul 21 10:46:54.342358 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 49/86] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:46:54 2022] GET /compute/v2.1/servers/691ae8fc-92e7-4940-99d8-7edb5a96d2f3 => generated 1246 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:46:54.494156 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-b37c9804-b902-461d-826a-216002a2e770 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:46:54.495663 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-b37c9804-b902-461d-826a-216002a2e770 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: 86715109-fd38-41f4-b384-a319c310fc44] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:46:54.503449 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b37c9804-b902-461d-826a-216002a2e770 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:54.506724 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b37c9804-b902-461d-826a-216002a2e770 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:54.506724 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b37c9804-b902-461d-826a-216002a2e770 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:54.506724 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b37c9804-b902-461d-826a-216002a2e770 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:54.675726 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-b37c9804-b902-461d-826a-216002a2e770 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:46:54.685558 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell0:SELECT=6 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:46:54.685558 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-b37c9804-b902-461d-826a-216002a2e770 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44" status: 200 len: 1321 microversion: 2.1 time: 0.194934 Jul 21 10:46:54.685558 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 38/87] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:46:54 2022] GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44 => generated 1321 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:46:54.941430 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-42fa3991-3274-41d2-b8ab-69bba80dc3ec tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:46:54.942223 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-42fa3991-3274-41d2-b8ab-69bba80dc3ec tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:46:54.959819 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-42fa3991-3274-41d2-b8ab-69bba80dc3ec tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:54.960705 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-42fa3991-3274-41d2-b8ab-69bba80dc3ec tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:54.962304 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-42fa3991-3274-41d2-b8ab-69bba80dc3ec tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:54.962928 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-42fa3991-3274-41d2-b8ab-69bba80dc3ec tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:55.115103 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-0c01b411-f8bf-4abc-8c57-032bd3140324 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:46:55.115655 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-0c01b411-f8bf-4abc-8c57-032bd3140324 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] [instance: 2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:46:55.125598 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0c01b411-f8bf-4abc-8c57-032bd3140324 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:55.126681 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0c01b411-f8bf-4abc-8c57-032bd3140324 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:55.128206 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0c01b411-f8bf-4abc-8c57-032bd3140324 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:55.128641 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0c01b411-f8bf-4abc-8c57-032bd3140324 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:55.198019 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-42fa3991-3274-41d2-b8ab-69bba80dc3ec tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:46:55.210720 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-42fa3991-3274-41d2-b8ab-69bba80dc3ec tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:46:55.210720 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-42fa3991-3274-41d2-b8ab-69bba80dc3ec tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:46:55.211680 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-42fa3991-3274-41d2-b8ab-69bba80dc3ec tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1407 microversion: 2.20 time: 0.274443 Jul 21 10:46:55.212434 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 50/88] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:46:54 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1407 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:46:55.343473 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-0c01b411-f8bf-4abc-8c57-032bd3140324 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7606b56fec4723b733f838ec34a17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceeabe5ea2a4a24b28901f50be5d532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:46:55.357619 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-0c01b411-f8bf-4abc-8c57-032bd3140324 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] 10.222.0.48 "GET /compute/v2.1/servers/2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985" status: 200 len: 1314 microversion: 2.1 time: 0.246332 Jul 21 10:46:55.358706 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 39/89] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:46:55 2022] GET /compute/v2.1/servers/2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985 => generated 1314 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:46:55.365582 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-fbb8c136-41a4-4668-8b3d-549db6bee37c tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:46:55.365582 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-fbb8c136-41a4-4668-8b3d-549db6bee37c tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 691ae8fc-92e7-4940-99d8-7edb5a96d2f3] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:46:55.367514 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell0:SELECT=24 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:46:55.373293 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-fbb8c136-41a4-4668-8b3d-549db6bee37c tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:55.374040 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-fbb8c136-41a4-4668-8b3d-549db6bee37c tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:55.374847 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-fbb8c136-41a4-4668-8b3d-549db6bee37c tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:55.375456 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-fbb8c136-41a4-4668-8b3d-549db6bee37c tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:55.456520 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-fbb8c136-41a4-4668-8b3d-549db6bee37c tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906e4bc4e9cc45ecb01cfca7918e461d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc215aadb5345d791945658832aae4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:46:55.465335 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-fbb8c136-41a4-4668-8b3d-549db6bee37c tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/691ae8fc-92e7-4940-99d8-7edb5a96d2f3" status: 200 len: 1246 microversion: 2.1 time: 0.109306 Jul 21 10:46:55.465925 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 51/90] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:46:55 2022] GET /compute/v2.1/servers/691ae8fc-92e7-4940-99d8-7edb5a96d2f3 => generated 1246 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:46:55.701431 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-007b0140-90f1-47d4-b55b-d8d9e0b8f9ab tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:46:55.702380 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-007b0140-90f1-47d4-b55b-d8d9e0b8f9ab tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: 86715109-fd38-41f4-b384-a319c310fc44] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:46:55.709052 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-007b0140-90f1-47d4-b55b-d8d9e0b8f9ab tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:55.709835 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-007b0140-90f1-47d4-b55b-d8d9e0b8f9ab tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:55.710884 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-007b0140-90f1-47d4-b55b-d8d9e0b8f9ab tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:55.711616 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-007b0140-90f1-47d4-b55b-d8d9e0b8f9ab tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:56.006620 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-007b0140-90f1-47d4-b55b-d8d9e0b8f9ab tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:46:56.006620 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-007b0140-90f1-47d4-b55b-d8d9e0b8f9ab tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44" status: 200 len: 1321 microversion: 2.1 time: 0.172505 Jul 21 10:46:56.006620 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 40/91] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:46:55 2022] GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44 => generated 1321 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:46:56.235512 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-12014854-3ad5-49af-8da5-172325559cc8 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:46:56.236105 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-12014854-3ad5-49af-8da5-172325559cc8 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:46:56.250225 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-12014854-3ad5-49af-8da5-172325559cc8 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:56.250968 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-12014854-3ad5-49af-8da5-172325559cc8 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:56.252343 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-12014854-3ad5-49af-8da5-172325559cc8 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:56.252775 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-12014854-3ad5-49af-8da5-172325559cc8 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:56.375064 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-340d89a5-70c5-43bd-ad3e-fbf0d769d9eb tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:46:56.375668 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-340d89a5-70c5-43bd-ad3e-fbf0d769d9eb tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] [instance: 2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:46:56.390844 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-340d89a5-70c5-43bd-ad3e-fbf0d769d9eb tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:56.391655 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-340d89a5-70c5-43bd-ad3e-fbf0d769d9eb tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:56.393332 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-340d89a5-70c5-43bd-ad3e-fbf0d769d9eb tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:56.394575 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-340d89a5-70c5-43bd-ad3e-fbf0d769d9eb tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:56.498271 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-12014854-3ad5-49af-8da5-172325559cc8 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:46:56.506656 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-12014854-3ad5-49af-8da5-172325559cc8 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:46:56.508517 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-12014854-3ad5-49af-8da5-172325559cc8 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:46:56.509677 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-12014854-3ad5-49af-8da5-172325559cc8 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1407 microversion: 2.20 time: 0.284282 Jul 21 10:46:56.510238 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 52/92] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:46:56 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1407 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 10:46:56.515324 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-7af004b3-6647-49e4-b8d4-76a1f2458385 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:46:56.515969 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-7af004b3-6647-49e4-b8d4-76a1f2458385 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 691ae8fc-92e7-4940-99d8-7edb5a96d2f3] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:46:56.522287 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7af004b3-6647-49e4-b8d4-76a1f2458385 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:56.522717 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7af004b3-6647-49e4-b8d4-76a1f2458385 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:56.523493 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7af004b3-6647-49e4-b8d4-76a1f2458385 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:56.523989 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7af004b3-6647-49e4-b8d4-76a1f2458385 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:56.577168 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-340d89a5-70c5-43bd-ad3e-fbf0d769d9eb tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7606b56fec4723b733f838ec34a17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceeabe5ea2a4a24b28901f50be5d532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:46:56.584837 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-340d89a5-70c5-43bd-ad3e-fbf0d769d9eb tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] 10.222.0.48 "GET /compute/v2.1/servers/2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985" status: 200 len: 1314 microversion: 2.1 time: 0.214042 Jul 21 10:46:56.592037 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 41/93] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:46:56 2022] GET /compute/v2.1/servers/2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985 => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:46:56.597505 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-7af004b3-6647-49e4-b8d4-76a1f2458385 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906e4bc4e9cc45ecb01cfca7918e461d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc215aadb5345d791945658832aae4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:46:56.604775 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-7af004b3-6647-49e4-b8d4-76a1f2458385 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/691ae8fc-92e7-4940-99d8-7edb5a96d2f3" status: 200 len: 1246 microversion: 2.1 time: 0.093522 Jul 21 10:46:56.605704 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 53/94] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:46:56 2022] GET /compute/v2.1/servers/691ae8fc-92e7-4940-99d8-7edb5a96d2f3 => generated 1246 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:46:56.954569 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-8bc26a06-2888-4a29-8168-7a206c2df261 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:46:56.954569 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-8bc26a06-2888-4a29-8168-7a206c2df261 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: 86715109-fd38-41f4-b384-a319c310fc44] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:46:56.960386 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8bc26a06-2888-4a29-8168-7a206c2df261 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:56.960823 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8bc26a06-2888-4a29-8168-7a206c2df261 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:56.961694 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8bc26a06-2888-4a29-8168-7a206c2df261 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:56.962164 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8bc26a06-2888-4a29-8168-7a206c2df261 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:57.137164 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-8bc26a06-2888-4a29-8168-7a206c2df261 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:46:57.144760 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-8bc26a06-2888-4a29-8168-7a206c2df261 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44" status: 200 len: 1321 microversion: 2.1 time: 0.194554 Jul 21 10:46:57.145571 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 42/95] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:46:56 2022] GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44 => generated 1321 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:46:57.531439 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-05d2e82e-a4d7-4716-b5e6-0b8106745bd8 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:46:57.532680 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-05d2e82e-a4d7-4716-b5e6-0b8106745bd8 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:46:57.540685 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-05d2e82e-a4d7-4716-b5e6-0b8106745bd8 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:57.541578 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-05d2e82e-a4d7-4716-b5e6-0b8106745bd8 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:57.542639 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-05d2e82e-a4d7-4716-b5e6-0b8106745bd8 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:57.543376 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-05d2e82e-a4d7-4716-b5e6-0b8106745bd8 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:57.603463 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-cd2149f4-e400-4d66-aa4f-4eb2b33020eb tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:46:57.604088 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-cd2149f4-e400-4d66-aa4f-4eb2b33020eb tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] [instance: 2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:46:57.607573 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell0:SELECT=26 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:46:57.615373 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-cd2149f4-e400-4d66-aa4f-4eb2b33020eb tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:57.615827 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-cd2149f4-e400-4d66-aa4f-4eb2b33020eb tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:57.618922 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-cd2149f4-e400-4d66-aa4f-4eb2b33020eb tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:57.619357 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-cd2149f4-e400-4d66-aa4f-4eb2b33020eb tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:57.741325 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-05d2e82e-a4d7-4716-b5e6-0b8106745bd8 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:46:57.755566 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-05d2e82e-a4d7-4716-b5e6-0b8106745bd8 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:46:57.757116 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-05d2e82e-a4d7-4716-b5e6-0b8106745bd8 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:46:57.758978 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-05d2e82e-a4d7-4716-b5e6-0b8106745bd8 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1407 microversion: 2.20 time: 0.230837 Jul 21 10:46:57.770372 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 54/96] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:46:57 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1407 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 10:46:57.776876 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-470006a4-9701-4ea2-bc73-181dc4a984f4 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:46:57.777663 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-470006a4-9701-4ea2-bc73-181dc4a984f4 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 691ae8fc-92e7-4940-99d8-7edb5a96d2f3] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:46:57.784407 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-470006a4-9701-4ea2-bc73-181dc4a984f4 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:57.785196 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-470006a4-9701-4ea2-bc73-181dc4a984f4 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:57.786286 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-470006a4-9701-4ea2-bc73-181dc4a984f4 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:57.786968 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-470006a4-9701-4ea2-bc73-181dc4a984f4 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:57.825258 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-cd2149f4-e400-4d66-aa4f-4eb2b33020eb tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7606b56fec4723b733f838ec34a17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceeabe5ea2a4a24b28901f50be5d532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:46:57.833868 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-cd2149f4-e400-4d66-aa4f-4eb2b33020eb tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] 10.222.0.48 "GET /compute/v2.1/servers/2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985" status: 200 len: 1314 microversion: 2.1 time: 0.235010 Jul 21 10:46:57.834456 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 43/97] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:46:57 2022] GET /compute/v2.1/servers/2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985 => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:46:57.855826 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-470006a4-9701-4ea2-bc73-181dc4a984f4 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906e4bc4e9cc45ecb01cfca7918e461d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc215aadb5345d791945658832aae4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:46:57.864379 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-470006a4-9701-4ea2-bc73-181dc4a984f4 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/691ae8fc-92e7-4940-99d8-7edb5a96d2f3" status: 200 len: 1238 microversion: 2.1 time: 0.092282 Jul 21 10:46:57.864870 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 55/98] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:46:57 2022] GET /compute/v2.1/servers/691ae8fc-92e7-4940-99d8-7edb5a96d2f3 => generated 1238 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:46:58.169054 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-5ac4b63f-2554-4eff-8f5a-d70395ec1080 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:46:58.169834 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-5ac4b63f-2554-4eff-8f5a-d70395ec1080 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: 86715109-fd38-41f4-b384-a319c310fc44] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:46:58.177547 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5ac4b63f-2554-4eff-8f5a-d70395ec1080 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:58.177992 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5ac4b63f-2554-4eff-8f5a-d70395ec1080 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:58.178791 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5ac4b63f-2554-4eff-8f5a-d70395ec1080 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:58.179219 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5ac4b63f-2554-4eff-8f5a-d70395ec1080 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:58.330649 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-5ac4b63f-2554-4eff-8f5a-d70395ec1080 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:46:58.339383 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-5ac4b63f-2554-4eff-8f5a-d70395ec1080 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44" status: 200 len: 1321 microversion: 2.1 time: 0.176849 Jul 21 10:46:58.339970 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 44/99] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:46:58 2022] GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44 => generated 1321 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:46:58.776099 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-9ddb0e01-64f0-411b-8bac-1b13a2c3d499 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:46:58.776786 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-9ddb0e01-64f0-411b-8bac-1b13a2c3d499 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:46:58.778672 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell0:SELECT=8 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:46:58.783916 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9ddb0e01-64f0-411b-8bac-1b13a2c3d499 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:58.784364 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9ddb0e01-64f0-411b-8bac-1b13a2c3d499 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:58.785141 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9ddb0e01-64f0-411b-8bac-1b13a2c3d499 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:58.785579 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9ddb0e01-64f0-411b-8bac-1b13a2c3d499 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:58.854793 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-ec8e0576-9182-4165-b97c-689c1cc364bf tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:46:58.854793 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-ec8e0576-9182-4165-b97c-689c1cc364bf tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] [instance: 2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:46:58.860458 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ec8e0576-9182-4165-b97c-689c1cc364bf tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:58.860648 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ec8e0576-9182-4165-b97c-689c1cc364bf tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:58.861417 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ec8e0576-9182-4165-b97c-689c1cc364bf tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:58.861846 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ec8e0576-9182-4165-b97c-689c1cc364bf tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:58.970458 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-9ddb0e01-64f0-411b-8bac-1b13a2c3d499 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:46:58.986739 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-9ddb0e01-64f0-411b-8bac-1b13a2c3d499 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:46:58.989526 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-9ddb0e01-64f0-411b-8bac-1b13a2c3d499 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:46:58.992908 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-9ddb0e01-64f0-411b-8bac-1b13a2c3d499 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1407 microversion: 2.20 time: 0.220660 Jul 21 10:46:58.994449 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 56/100] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:46:58 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1407 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 10:46:59.003889 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-31334ef3-691a-454e-96c4-54a85c64a091 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:46:59.003889 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-31334ef3-691a-454e-96c4-54a85c64a091 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 691ae8fc-92e7-4940-99d8-7edb5a96d2f3] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:46:59.013567 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-31334ef3-691a-454e-96c4-54a85c64a091 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:59.014256 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-31334ef3-691a-454e-96c4-54a85c64a091 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:59.015548 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-31334ef3-691a-454e-96c4-54a85c64a091 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:59.016264 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-31334ef3-691a-454e-96c4-54a85c64a091 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:59.033962 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-ec8e0576-9182-4165-b97c-689c1cc364bf tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7606b56fec4723b733f838ec34a17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceeabe5ea2a4a24b28901f50be5d532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:46:59.045842 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-ec8e0576-9182-4165-b97c-689c1cc364bf tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] 10.222.0.48 "GET /compute/v2.1/servers/2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985" status: 200 len: 1314 microversion: 2.1 time: 0.198510 Jul 21 10:46:59.046434 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 45/101] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:46:58 2022] GET /compute/v2.1/servers/2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985 => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:46:59.085184 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-31334ef3-691a-454e-96c4-54a85c64a091 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906e4bc4e9cc45ecb01cfca7918e461d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc215aadb5345d791945658832aae4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:46:59.093560 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-31334ef3-691a-454e-96c4-54a85c64a091 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/691ae8fc-92e7-4940-99d8-7edb5a96d2f3" status: 200 len: 1238 microversion: 2.1 time: 0.097718 Jul 21 10:46:59.094325 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 57/102] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:46:58 2022] GET /compute/v2.1/servers/691ae8fc-92e7-4940-99d8-7edb5a96d2f3 => generated 1238 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:46:59.356360 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-4cc69e19-b0cc-4aed-ab67-c60278d8fd71 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:46:59.356971 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-4cc69e19-b0cc-4aed-ab67-c60278d8fd71 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: 86715109-fd38-41f4-b384-a319c310fc44] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:46:59.363695 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-4cc69e19-b0cc-4aed-ab67-c60278d8fd71 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:59.364142 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-4cc69e19-b0cc-4aed-ab67-c60278d8fd71 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:59.364934 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-4cc69e19-b0cc-4aed-ab67-c60278d8fd71 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:46:59.365362 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-4cc69e19-b0cc-4aed-ab67-c60278d8fd71 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:46:59.504207 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-4cc69e19-b0cc-4aed-ab67-c60278d8fd71 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:46:59.514566 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-4cc69e19-b0cc-4aed-ab67-c60278d8fd71 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44" status: 200 len: 1321 microversion: 2.1 time: 0.162543 Jul 21 10:46:59.515268 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 46/103] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:46:59 2022] GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44 => generated 1321 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:47:00.012100 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-7d1278bc-34b6-43d8-baf6-ba75f42f9dc7 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:47:00.012705 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-7d1278bc-34b6-43d8-baf6-ba75f42f9dc7 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:47:00.019095 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7d1278bc-34b6-43d8-baf6-ba75f42f9dc7 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:00.019538 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7d1278bc-34b6-43d8-baf6-ba75f42f9dc7 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:00.020291 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7d1278bc-34b6-43d8-baf6-ba75f42f9dc7 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:00.021155 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7d1278bc-34b6-43d8-baf6-ba75f42f9dc7 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:00.063885 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-64dae6a7-1571-4dcc-a374-54c0471c80be tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:47:00.065934 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-64dae6a7-1571-4dcc-a374-54c0471c80be tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] [instance: 2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:47:00.072731 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-64dae6a7-1571-4dcc-a374-54c0471c80be tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:00.073314 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-64dae6a7-1571-4dcc-a374-54c0471c80be tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:00.074191 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-64dae6a7-1571-4dcc-a374-54c0471c80be tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:00.074757 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-64dae6a7-1571-4dcc-a374-54c0471c80be tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:00.218242 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-7d1278bc-34b6-43d8-baf6-ba75f42f9dc7 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:00.230216 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-7d1278bc-34b6-43d8-baf6-ba75f42f9dc7 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:00.231778 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-7d1278bc-34b6-43d8-baf6-ba75f42f9dc7 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:00.238002 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-7d1278bc-34b6-43d8-baf6-ba75f42f9dc7 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1407 microversion: 2.20 time: 0.230235 Jul 21 10:47:00.238632 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 58/104] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:47:00 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1407 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:47:00.243842 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-bd9fe4eb-6dfd-4a65-a4c0-b97b17f73693 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:47:00.244526 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-bd9fe4eb-6dfd-4a65-a4c0-b97b17f73693 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 691ae8fc-92e7-4940-99d8-7edb5a96d2f3] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:47:00.253260 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-bd9fe4eb-6dfd-4a65-a4c0-b97b17f73693 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:00.255416 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-bd9fe4eb-6dfd-4a65-a4c0-b97b17f73693 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:00.255416 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-bd9fe4eb-6dfd-4a65-a4c0-b97b17f73693 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:00.255416 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-bd9fe4eb-6dfd-4a65-a4c0-b97b17f73693 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:00.260743 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell1:SELECT=100 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:47:00.274563 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-64dae6a7-1571-4dcc-a374-54c0471c80be tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7606b56fec4723b733f838ec34a17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceeabe5ea2a4a24b28901f50be5d532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:00.284662 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-64dae6a7-1571-4dcc-a374-54c0471c80be tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] 10.222.0.48 "GET /compute/v2.1/servers/2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985" status: 200 len: 1314 microversion: 2.1 time: 0.221739 Jul 21 10:47:00.284662 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 47/105] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:47:00 2022] GET /compute/v2.1/servers/2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985 => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:47:00.330764 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-bd9fe4eb-6dfd-4a65-a4c0-b97b17f73693 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906e4bc4e9cc45ecb01cfca7918e461d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc215aadb5345d791945658832aae4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:00.339676 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-bd9fe4eb-6dfd-4a65-a4c0-b97b17f73693 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/691ae8fc-92e7-4940-99d8-7edb5a96d2f3" status: 200 len: 1294 microversion: 2.1 time: 0.100046 Jul 21 10:47:00.350507 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 59/106] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:47:00 2022] GET /compute/v2.1/servers/691ae8fc-92e7-4940-99d8-7edb5a96d2f3 => generated 1294 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:47:00.530487 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-8ba20567-2b1a-4bd7-8a93-f7662d9d143d tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:47:00.531133 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-8ba20567-2b1a-4bd7-8a93-f7662d9d143d tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: 86715109-fd38-41f4-b384-a319c310fc44] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:47:00.537025 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8ba20567-2b1a-4bd7-8a93-f7662d9d143d tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:00.537487 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8ba20567-2b1a-4bd7-8a93-f7662d9d143d tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:00.538239 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8ba20567-2b1a-4bd7-8a93-f7662d9d143d tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:00.538708 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8ba20567-2b1a-4bd7-8a93-f7662d9d143d tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:00.673118 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-8ba20567-2b1a-4bd7-8a93-f7662d9d143d tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:00.681243 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-8ba20567-2b1a-4bd7-8a93-f7662d9d143d tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44" status: 200 len: 1321 microversion: 2.1 time: 0.154625 Jul 21 10:47:00.681829 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 48/107] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:47:00 2022] GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44 => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:47:01.257232 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-01b8b291-7b4c-4f32-847b-c7ea2f26710c tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:47:01.257853 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-01b8b291-7b4c-4f32-847b-c7ea2f26710c tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:47:01.265500 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-01b8b291-7b4c-4f32-847b-c7ea2f26710c tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:01.265961 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-01b8b291-7b4c-4f32-847b-c7ea2f26710c tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:01.266811 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-01b8b291-7b4c-4f32-847b-c7ea2f26710c tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:01.267270 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-01b8b291-7b4c-4f32-847b-c7ea2f26710c tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:01.301411 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-15a7fce5-6479-43cc-af09-693b8cbe8530 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:47:01.302426 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-15a7fce5-6479-43cc-af09-693b8cbe8530 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] [instance: 2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:47:01.315355 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-15a7fce5-6479-43cc-af09-693b8cbe8530 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:01.316470 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-15a7fce5-6479-43cc-af09-693b8cbe8530 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:01.317137 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-15a7fce5-6479-43cc-af09-693b8cbe8530 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:01.317622 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-15a7fce5-6479-43cc-af09-693b8cbe8530 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:01.720820 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-01b8b291-7b4c-4f32-847b-c7ea2f26710c tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:01.730965 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-01b8b291-7b4c-4f32-847b-c7ea2f26710c tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:01.732549 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-01b8b291-7b4c-4f32-847b-c7ea2f26710c tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:01.733825 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-01b8b291-7b4c-4f32-847b-c7ea2f26710c tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1407 microversion: 2.20 time: 0.480914 Jul 21 10:47:01.734390 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 60/108] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:47:01 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1407 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:47:01.739251 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-36da49d9-e83c-4bf6-bfb4-7e1034890589 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:47:01.740736 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-36da49d9-e83c-4bf6-bfb4-7e1034890589 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 691ae8fc-92e7-4940-99d8-7edb5a96d2f3] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:47:01.748930 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-36da49d9-e83c-4bf6-bfb4-7e1034890589 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:01.749377 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-36da49d9-e83c-4bf6-bfb4-7e1034890589 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:01.750148 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-36da49d9-e83c-4bf6-bfb4-7e1034890589 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:01.751156 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-36da49d9-e83c-4bf6-bfb4-7e1034890589 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:01.778168 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-15a7fce5-6479-43cc-af09-693b8cbe8530 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7606b56fec4723b733f838ec34a17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceeabe5ea2a4a24b28901f50be5d532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:01.793320 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-15a7fce5-6479-43cc-af09-693b8cbe8530 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] 10.222.0.48 "GET /compute/v2.1/servers/2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985" status: 200 len: 1314 microversion: 2.1 time: 0.494892 Jul 21 10:47:01.794345 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 49/109] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:47:01 2022] GET /compute/v2.1/servers/2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985 => generated 1314 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:47:01.801290 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-55a73745-47ae-4728-a63a-f315e8ce160d tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:47:01.802199 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-55a73745-47ae-4728-a63a-f315e8ce160d tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: 86715109-fd38-41f4-b384-a319c310fc44] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:47:01.809123 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-55a73745-47ae-4728-a63a-f315e8ce160d tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:01.809671 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-55a73745-47ae-4728-a63a-f315e8ce160d tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:01.810522 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-55a73745-47ae-4728-a63a-f315e8ce160d tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:01.820756 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-55a73745-47ae-4728-a63a-f315e8ce160d tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:01.845739 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell1:SELECT=100 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:47:01.886899 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-36da49d9-e83c-4bf6-bfb4-7e1034890589 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906e4bc4e9cc45ecb01cfca7918e461d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc215aadb5345d791945658832aae4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:01.896318 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-36da49d9-e83c-4bf6-bfb4-7e1034890589 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/691ae8fc-92e7-4940-99d8-7edb5a96d2f3" status: 200 len: 1294 microversion: 2.1 time: 0.160802 Jul 21 10:47:01.897027 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 61/110] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:47:01 2022] GET /compute/v2.1/servers/691ae8fc-92e7-4940-99d8-7edb5a96d2f3 => generated 1294 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:47:02.230762 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-55a73745-47ae-4728-a63a-f315e8ce160d tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:02.241818 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-55a73745-47ae-4728-a63a-f315e8ce160d tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44" status: 200 len: 1321 microversion: 2.1 time: 0.445909 Jul 21 10:47:02.266097 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 50/111] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:47:01 2022] GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44 => generated 1321 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:47:02.753430 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-d64ade63-66f4-4996-b549-915eb25cf6f1 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:47:02.754034 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-d64ade63-66f4-4996-b549-915eb25cf6f1 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:47:02.760140 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d64ade63-66f4-4996-b549-915eb25cf6f1 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:02.760593 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d64ade63-66f4-4996-b549-915eb25cf6f1 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:02.761353 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d64ade63-66f4-4996-b549-915eb25cf6f1 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:02.761787 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d64ade63-66f4-4996-b549-915eb25cf6f1 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:02.811514 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-38f51e44-1716-4276-a618-51b9dafc6813 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:47:02.812878 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-38f51e44-1716-4276-a618-51b9dafc6813 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] [instance: 2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:47:02.825199 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-38f51e44-1716-4276-a618-51b9dafc6813 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:02.835306 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-38f51e44-1716-4276-a618-51b9dafc6813 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:02.837521 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-38f51e44-1716-4276-a618-51b9dafc6813 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:02.838002 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-38f51e44-1716-4276-a618-51b9dafc6813 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:02.988146 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-d64ade63-66f4-4996-b549-915eb25cf6f1 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:03.005710 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-d64ade63-66f4-4996-b549-915eb25cf6f1 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:03.008447 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-d64ade63-66f4-4996-b549-915eb25cf6f1 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:03.010307 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-d64ade63-66f4-4996-b549-915eb25cf6f1 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1407 microversion: 2.20 time: 0.260910 Jul 21 10:47:03.011624 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 62/112] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:47:02 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1407 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:47:03.016453 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-7330b072-07f6-47b2-851c-aad8a07fd430 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:47:03.017059 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-7330b072-07f6-47b2-851c-aad8a07fd430 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 691ae8fc-92e7-4940-99d8-7edb5a96d2f3] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:47:03.018590 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-38f51e44-1716-4276-a618-51b9dafc6813 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7606b56fec4723b733f838ec34a17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceeabe5ea2a4a24b28901f50be5d532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:03.023304 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7330b072-07f6-47b2-851c-aad8a07fd430 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:03.024632 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7330b072-07f6-47b2-851c-aad8a07fd430 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:03.024768 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7330b072-07f6-47b2-851c-aad8a07fd430 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:03.025364 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7330b072-07f6-47b2-851c-aad8a07fd430 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:03.030437 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-38f51e44-1716-4276-a618-51b9dafc6813 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] 10.222.0.48 "GET /compute/v2.1/servers/2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985" status: 200 len: 1314 microversion: 2.1 time: 0.223152 Jul 21 10:47:03.041556 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 51/113] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:47:02 2022] GET /compute/v2.1/servers/2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985 => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:47:03.089753 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-7330b072-07f6-47b2-851c-aad8a07fd430 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906e4bc4e9cc45ecb01cfca7918e461d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc215aadb5345d791945658832aae4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:03.097721 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-7330b072-07f6-47b2-851c-aad8a07fd430 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/691ae8fc-92e7-4940-99d8-7edb5a96d2f3" status: 200 len: 1312 microversion: 2.1 time: 0.084882 Jul 21 10:47:03.098309 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 63/114] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:47:03 2022] GET /compute/v2.1/servers/691ae8fc-92e7-4940-99d8-7edb5a96d2f3 => generated 1312 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:47:03.259958 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-8af79fe4-23b7-4871-a82d-2d637389f660 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:47:03.260619 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-8af79fe4-23b7-4871-a82d-2d637389f660 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: 86715109-fd38-41f4-b384-a319c310fc44] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:47:03.267001 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8af79fe4-23b7-4871-a82d-2d637389f660 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:03.267453 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8af79fe4-23b7-4871-a82d-2d637389f660 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:03.268231 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8af79fe4-23b7-4871-a82d-2d637389f660 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:03.268664 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8af79fe4-23b7-4871-a82d-2d637389f660 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:03.474995 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-8af79fe4-23b7-4871-a82d-2d637389f660 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:03.479907 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-8af79fe4-23b7-4871-a82d-2d637389f660 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44" status: 200 len: 1321 microversion: 2.1 time: 0.224232 Jul 21 10:47:03.480823 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 52/115] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:47:03 2022] GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44 => generated 1321 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:47:04.029821 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-26db97c6-1163-4c4c-ae5e-80b3ab40c6b5 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:47:04.030343 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-26db97c6-1163-4c4c-ae5e-80b3ab40c6b5 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:47:04.036681 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-26db97c6-1163-4c4c-ae5e-80b3ab40c6b5 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:04.037136 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-26db97c6-1163-4c4c-ae5e-80b3ab40c6b5 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:04.038491 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-26db97c6-1163-4c4c-ae5e-80b3ab40c6b5 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:04.038491 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-26db97c6-1163-4c4c-ae5e-80b3ab40c6b5 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:04.049067 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-3614e522-7f00-4d89-829e-6739930f2132 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:47:04.049667 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-3614e522-7f00-4d89-829e-6739930f2132 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] [instance: 2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:47:04.056673 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3614e522-7f00-4d89-829e-6739930f2132 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:04.061944 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3614e522-7f00-4d89-829e-6739930f2132 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:04.061944 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3614e522-7f00-4d89-829e-6739930f2132 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:04.061944 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3614e522-7f00-4d89-829e-6739930f2132 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:04.266069 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-26db97c6-1163-4c4c-ae5e-80b3ab40c6b5 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:04.271288 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-3614e522-7f00-4d89-829e-6739930f2132 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7606b56fec4723b733f838ec34a17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceeabe5ea2a4a24b28901f50be5d532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:04.274504 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-26db97c6-1163-4c4c-ae5e-80b3ab40c6b5 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:04.281180 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-26db97c6-1163-4c4c-ae5e-80b3ab40c6b5 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:04.281180 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-26db97c6-1163-4c4c-ae5e-80b3ab40c6b5 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1407 microversion: 2.20 time: 0.251452 Jul 21 10:47:04.281180 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 64/116] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:47:04 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1407 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:47:04.281452 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-3614e522-7f00-4d89-829e-6739930f2132 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] 10.222.0.48 "GET /compute/v2.1/servers/2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985" status: 200 len: 1314 microversion: 2.1 time: 0.233716 Jul 21 10:47:04.282880 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-7527f446-66fe-4a71-9a14-61a3a9d791f6 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:47:04.283635 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-7527f446-66fe-4a71-9a14-61a3a9d791f6 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 691ae8fc-92e7-4940-99d8-7edb5a96d2f3] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:47:04.289508 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 53/117] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:47:04 2022] GET /compute/v2.1/servers/2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985 => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:47:04.291073 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7527f446-66fe-4a71-9a14-61a3a9d791f6 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:04.291557 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7527f446-66fe-4a71-9a14-61a3a9d791f6 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:04.292328 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7527f446-66fe-4a71-9a14-61a3a9d791f6 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:04.292759 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7527f446-66fe-4a71-9a14-61a3a9d791f6 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:04.358598 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-7527f446-66fe-4a71-9a14-61a3a9d791f6 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906e4bc4e9cc45ecb01cfca7918e461d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc215aadb5345d791945658832aae4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:04.366286 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-7527f446-66fe-4a71-9a14-61a3a9d791f6 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/691ae8fc-92e7-4940-99d8-7edb5a96d2f3" status: 200 len: 1300 microversion: 2.1 time: 0.087469 Jul 21 10:47:04.366885 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 65/118] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:47:04 2022] GET /compute/v2.1/servers/691ae8fc-92e7-4940-99d8-7edb5a96d2f3 => generated 1300 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:47:04.497039 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-72cf890d-588e-4b9c-84cd-7e480b59f6e7 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:47:04.497643 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-72cf890d-588e-4b9c-84cd-7e480b59f6e7 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: 86715109-fd38-41f4-b384-a319c310fc44] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:47:04.503632 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-72cf890d-588e-4b9c-84cd-7e480b59f6e7 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:04.504079 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-72cf890d-588e-4b9c-84cd-7e480b59f6e7 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:04.504844 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-72cf890d-588e-4b9c-84cd-7e480b59f6e7 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:04.505334 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-72cf890d-588e-4b9c-84cd-7e480b59f6e7 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:04.645438 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-72cf890d-588e-4b9c-84cd-7e480b59f6e7 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:04.653452 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-72cf890d-588e-4b9c-84cd-7e480b59f6e7 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44" status: 200 len: 1321 microversion: 2.1 time: 0.160050 Jul 21 10:47:04.653857 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 54/119] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:47:04 2022] GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44 => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:47:05.296269 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-0d1e227e-cc60-4b74-9979-f1218458c9bb tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:47:05.296865 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-0d1e227e-cc60-4b74-9979-f1218458c9bb tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:47:05.297042 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-676ed366-1f54-4d96-96b0-ff525e69b5b1 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:47:05.298025 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-676ed366-1f54-4d96-96b0-ff525e69b5b1 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] [instance: 2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:47:05.302890 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0d1e227e-cc60-4b74-9979-f1218458c9bb tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:05.303326 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0d1e227e-cc60-4b74-9979-f1218458c9bb tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:05.304089 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0d1e227e-cc60-4b74-9979-f1218458c9bb tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:05.304519 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0d1e227e-cc60-4b74-9979-f1218458c9bb tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:05.304653 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-676ed366-1f54-4d96-96b0-ff525e69b5b1 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:05.305079 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-676ed366-1f54-4d96-96b0-ff525e69b5b1 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:05.305994 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-676ed366-1f54-4d96-96b0-ff525e69b5b1 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:05.306776 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-676ed366-1f54-4d96-96b0-ff525e69b5b1 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:05.517994 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-676ed366-1f54-4d96-96b0-ff525e69b5b1 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7606b56fec4723b733f838ec34a17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceeabe5ea2a4a24b28901f50be5d532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:05.520554 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-0d1e227e-cc60-4b74-9979-f1218458c9bb tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:05.526299 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-676ed366-1f54-4d96-96b0-ff525e69b5b1 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] 10.222.0.48 "GET /compute/v2.1/servers/2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985" status: 200 len: 1314 microversion: 2.1 time: 0.233780 Jul 21 10:47:05.526927 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 55/120] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:47:05 2022] GET /compute/v2.1/servers/2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985 => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:47:05.531660 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-ace51756-cd85-4aef-a899-b0a505dfe747 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:47:05.532267 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-ace51756-cd85-4aef-a899-b0a505dfe747 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 691ae8fc-92e7-4940-99d8-7edb5a96d2f3] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:47:05.534324 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-0d1e227e-cc60-4b74-9979-f1218458c9bb tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:05.538293 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ace51756-cd85-4aef-a899-b0a505dfe747 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:05.538781 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ace51756-cd85-4aef-a899-b0a505dfe747 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:05.539264 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-0d1e227e-cc60-4b74-9979-f1218458c9bb tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:05.540162 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ace51756-cd85-4aef-a899-b0a505dfe747 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:05.540599 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ace51756-cd85-4aef-a899-b0a505dfe747 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:05.542375 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-0d1e227e-cc60-4b74-9979-f1218458c9bb tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1407 microversion: 2.20 time: 0.249944 Jul 21 10:47:05.559089 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 66/121] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:47:05 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1407 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:47:05.607844 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-ace51756-cd85-4aef-a899-b0a505dfe747 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906e4bc4e9cc45ecb01cfca7918e461d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc215aadb5345d791945658832aae4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:05.615954 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-ace51756-cd85-4aef-a899-b0a505dfe747 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/691ae8fc-92e7-4940-99d8-7edb5a96d2f3" status: 200 len: 1300 microversion: 2.1 time: 0.087810 Jul 21 10:47:05.616537 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 56/122] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:47:05 2022] GET /compute/v2.1/servers/691ae8fc-92e7-4940-99d8-7edb5a96d2f3 => generated 1300 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:47:05.669839 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-78aa2d94-e801-4166-a43d-6aee12633ab3 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:47:05.670447 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-78aa2d94-e801-4166-a43d-6aee12633ab3 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: 86715109-fd38-41f4-b384-a319c310fc44] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:47:05.676589 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-78aa2d94-e801-4166-a43d-6aee12633ab3 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:05.677036 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-78aa2d94-e801-4166-a43d-6aee12633ab3 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:05.677796 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-78aa2d94-e801-4166-a43d-6aee12633ab3 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:05.678272 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-78aa2d94-e801-4166-a43d-6aee12633ab3 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:05.815580 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-78aa2d94-e801-4166-a43d-6aee12633ab3 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:05.829510 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-78aa2d94-e801-4166-a43d-6aee12633ab3 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44" status: 200 len: 1321 microversion: 2.1 time: 0.157714 Jul 21 10:47:05.829510 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 67/123] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:47:05 2022] GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44 => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:47:06.544127 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-8d8b7046-2b79-46c2-a4a9-bbd2286fc342 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:47:06.544745 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-8d8b7046-2b79-46c2-a4a9-bbd2286fc342 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] [instance: 2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:47:06.551036 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8d8b7046-2b79-46c2-a4a9-bbd2286fc342 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:06.551484 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8d8b7046-2b79-46c2-a4a9-bbd2286fc342 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:06.552240 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8d8b7046-2b79-46c2-a4a9-bbd2286fc342 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:06.552672 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8d8b7046-2b79-46c2-a4a9-bbd2286fc342 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:06.566164 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-e42c8518-62ce-47a3-89ca-bddbe407f83d tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:47:06.566832 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-e42c8518-62ce-47a3-89ca-bddbe407f83d tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:47:06.573253 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e42c8518-62ce-47a3-89ca-bddbe407f83d tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:06.574035 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e42c8518-62ce-47a3-89ca-bddbe407f83d tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:06.574846 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e42c8518-62ce-47a3-89ca-bddbe407f83d tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:06.575285 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e42c8518-62ce-47a3-89ca-bddbe407f83d tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:06.791648 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-8d8b7046-2b79-46c2-a4a9-bbd2286fc342 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7606b56fec4723b733f838ec34a17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceeabe5ea2a4a24b28901f50be5d532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:06.801641 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-e42c8518-62ce-47a3-89ca-bddbe407f83d tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:06.803860 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-8d8b7046-2b79-46c2-a4a9-bbd2286fc342 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] 10.222.0.48 "GET /compute/v2.1/servers/2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985" status: 200 len: 1314 microversion: 2.1 time: 0.264435 Jul 21 10:47:06.806362 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 57/124] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:47:06 2022] GET /compute/v2.1/servers/2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985 => generated 1314 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:47:06.812619 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-21803836-d107-4357-882c-31883e00e635 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:47:06.817135 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-21803836-d107-4357-882c-31883e00e635 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 691ae8fc-92e7-4940-99d8-7edb5a96d2f3] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:47:06.821169 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-21803836-d107-4357-882c-31883e00e635 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:06.822958 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-21803836-d107-4357-882c-31883e00e635 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:06.824422 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-21803836-d107-4357-882c-31883e00e635 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:06.825065 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-21803836-d107-4357-882c-31883e00e635 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:06.828381 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-e42c8518-62ce-47a3-89ca-bddbe407f83d tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:06.832873 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-e42c8518-62ce-47a3-89ca-bddbe407f83d tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:06.837393 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-e42c8518-62ce-47a3-89ca-bddbe407f83d tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1407 microversion: 2.20 time: 0.275793 Jul 21 10:47:06.841409 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 68/125] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:47:06 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1407 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:47:06.844577 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-ea1dc291-bc2f-4707-aa65-89bac9ddfe3f tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:47:06.845257 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-ea1dc291-bc2f-4707-aa65-89bac9ddfe3f tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: 86715109-fd38-41f4-b384-a319c310fc44] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:47:06.853130 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ea1dc291-bc2f-4707-aa65-89bac9ddfe3f tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:06.853581 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ea1dc291-bc2f-4707-aa65-89bac9ddfe3f tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:06.854352 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ea1dc291-bc2f-4707-aa65-89bac9ddfe3f tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:06.854833 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ea1dc291-bc2f-4707-aa65-89bac9ddfe3f tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:06.937758 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-21803836-d107-4357-882c-31883e00e635 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906e4bc4e9cc45ecb01cfca7918e461d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc215aadb5345d791945658832aae4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:06.948035 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-21803836-d107-4357-882c-31883e00e635 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/691ae8fc-92e7-4940-99d8-7edb5a96d2f3" status: 200 len: 1300 microversion: 2.1 time: 0.139963 Jul 21 10:47:06.949011 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 58/126] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:47:06 2022] GET /compute/v2.1/servers/691ae8fc-92e7-4940-99d8-7edb5a96d2f3 => generated 1300 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:47:07.074955 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-ea1dc291-bc2f-4707-aa65-89bac9ddfe3f tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:07.094427 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-ea1dc291-bc2f-4707-aa65-89bac9ddfe3f tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44" status: 200 len: 1321 microversion: 2.1 time: 0.254316 Jul 21 10:47:07.106029 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 69/127] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:47:06 2022] GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44 => generated 1321 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:47:07.408902 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [req-03e544c9-6274-40bc-8d03-7502261b4f8e req-46d5246e-9bea-4384-8a54-6c3489643988 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985", "name": "network-vif-plugged", "status": "completed", "tag": "606e38eb-2f20-4811-87d6-bf2ef650eb71"}]} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:47:07.408902 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-03e544c9-6274-40bc-8d03-7502261b4f8e req-46d5246e-9bea-4384-8a54-6c3489643988 service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:07.408902 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-03e544c9-6274-40bc-8d03-7502261b4f8e req-46d5246e-9bea-4384-8a54-6c3489643988 service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:07.415530 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.compute.server_external_events [req-03e544c9-6274-40bc-8d03-7502261b4f8e req-46d5246e-9bea-4384-8a54-6c3489643988 service nova] Creating event network-vif-plugged:606e38eb-2f20-4811-87d6-bf2ef650eb71 for instance 2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985 on hv-cinder-84980 Jul 21 10:47:07.420567 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [req-03e544c9-6274-40bc-8d03-7502261b4f8e req-46d5246e-9bea-4384-8a54-6c3489643988 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099988 Jul 21 10:47:07.427238 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 59/128] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 21 10:47:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:47:07.823450 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-67ab248a-4043-422f-871f-bc26af8aa620 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:47:07.823968 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-67ab248a-4043-422f-871f-bc26af8aa620 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] [instance: 2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:47:07.830094 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-67ab248a-4043-422f-871f-bc26af8aa620 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:07.830783 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-67ab248a-4043-422f-871f-bc26af8aa620 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:07.831940 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-67ab248a-4043-422f-871f-bc26af8aa620 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:07.831940 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-67ab248a-4043-422f-871f-bc26af8aa620 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:07.861335 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-2961bf88-2fd6-4e80-a5a4-69bea1aa546b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:47:07.862063 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-2961bf88-2fd6-4e80-a5a4-69bea1aa546b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:47:07.868931 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2961bf88-2fd6-4e80-a5a4-69bea1aa546b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:07.869488 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2961bf88-2fd6-4e80-a5a4-69bea1aa546b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:07.870333 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2961bf88-2fd6-4e80-a5a4-69bea1aa546b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:07.870984 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2961bf88-2fd6-4e80-a5a4-69bea1aa546b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:08.022755 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-67ab248a-4043-422f-871f-bc26af8aa620 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7606b56fec4723b733f838ec34a17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceeabe5ea2a4a24b28901f50be5d532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:08.030721 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-67ab248a-4043-422f-871f-bc26af8aa620 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] 10.222.0.48 "GET /compute/v2.1/servers/2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985" status: 200 len: 1314 microversion: 2.1 time: 0.211220 Jul 21 10:47:08.042048 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 70/129] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:47:07 2022] GET /compute/v2.1/servers/2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985 => generated 1314 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:47:08.042048 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-bf676bd3-9072-4d49-94d7-07678e190ea1 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:47:08.042048 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-bf676bd3-9072-4d49-94d7-07678e190ea1 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 691ae8fc-92e7-4940-99d8-7edb5a96d2f3] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:47:08.047282 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-bf676bd3-9072-4d49-94d7-07678e190ea1 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:08.047282 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-bf676bd3-9072-4d49-94d7-07678e190ea1 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:08.047282 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-bf676bd3-9072-4d49-94d7-07678e190ea1 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:08.047282 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-bf676bd3-9072-4d49-94d7-07678e190ea1 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:08.053484 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-2961bf88-2fd6-4e80-a5a4-69bea1aa546b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:08.062005 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-2961bf88-2fd6-4e80-a5a4-69bea1aa546b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:08.063639 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-2961bf88-2fd6-4e80-a5a4-69bea1aa546b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:08.064923 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-2961bf88-2fd6-4e80-a5a4-69bea1aa546b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1407 microversion: 2.20 time: 0.208128 Jul 21 10:47:08.074978 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 60/130] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:47:07 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1407 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:47:08.116917 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-bbaba31b-ba9f-43f3-8e8a-7f07d9abd75b tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:47:08.119572 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-bf676bd3-9072-4d49-94d7-07678e190ea1 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906e4bc4e9cc45ecb01cfca7918e461d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc215aadb5345d791945658832aae4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:08.120286 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-bbaba31b-ba9f-43f3-8e8a-7f07d9abd75b tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: 86715109-fd38-41f4-b384-a319c310fc44] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:47:08.141865 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-bbaba31b-ba9f-43f3-8e8a-7f07d9abd75b tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:08.142630 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-bbaba31b-ba9f-43f3-8e8a-7f07d9abd75b tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:08.143727 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-bf676bd3-9072-4d49-94d7-07678e190ea1 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/691ae8fc-92e7-4940-99d8-7edb5a96d2f3" status: 200 len: 1300 microversion: 2.1 time: 0.110652 Jul 21 10:47:08.144954 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 71/131] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:47:08 2022] GET /compute/v2.1/servers/691ae8fc-92e7-4940-99d8-7edb5a96d2f3 => generated 1300 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:47:08.145303 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-bbaba31b-ba9f-43f3-8e8a-7f07d9abd75b tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:08.145888 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-bbaba31b-ba9f-43f3-8e8a-7f07d9abd75b tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:08.318962 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-bbaba31b-ba9f-43f3-8e8a-7f07d9abd75b tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:08.327705 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-bbaba31b-ba9f-43f3-8e8a-7f07d9abd75b tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44" status: 200 len: 1321 microversion: 2.1 time: 0.214514 Jul 21 10:47:08.328752 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 61/132] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:47:08 2022] GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44 => generated 1321 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:47:09.049708 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-fa76cae2-e7aa-433f-a47b-74f2019f82d1 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:47:09.050460 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-fa76cae2-e7aa-433f-a47b-74f2019f82d1 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] [instance: 2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:47:09.070840 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-fa76cae2-e7aa-433f-a47b-74f2019f82d1 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:09.072242 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-fa76cae2-e7aa-433f-a47b-74f2019f82d1 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:09.073222 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-fa76cae2-e7aa-433f-a47b-74f2019f82d1 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:09.075168 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-fa76cae2-e7aa-433f-a47b-74f2019f82d1 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:09.093095 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-77c5b65c-83aa-45cd-a505-3a4a59d3e729 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:47:09.095693 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-77c5b65c-83aa-45cd-a505-3a4a59d3e729 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:47:09.107781 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-77c5b65c-83aa-45cd-a505-3a4a59d3e729 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:09.108702 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-77c5b65c-83aa-45cd-a505-3a4a59d3e729 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:09.109892 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-77c5b65c-83aa-45cd-a505-3a4a59d3e729 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:09.114684 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-77c5b65c-83aa-45cd-a505-3a4a59d3e729 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:09.424194 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-fa76cae2-e7aa-433f-a47b-74f2019f82d1 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7606b56fec4723b733f838ec34a17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceeabe5ea2a4a24b28901f50be5d532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:09.434260 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-fa76cae2-e7aa-433f-a47b-74f2019f82d1 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] 10.222.0.48 "GET /compute/v2.1/servers/2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985" status: 200 len: 1314 microversion: 2.1 time: 0.387990 Jul 21 10:47:09.434260 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 72/133] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:47:09 2022] GET /compute/v2.1/servers/2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985 => generated 1314 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:47:09.439205 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-a64d8d97-9596-4398-baac-36fc892a788b tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:47:09.439815 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-a64d8d97-9596-4398-baac-36fc892a788b tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 691ae8fc-92e7-4940-99d8-7edb5a96d2f3] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:47:09.452696 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a64d8d97-9596-4398-baac-36fc892a788b tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:09.453555 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a64d8d97-9596-4398-baac-36fc892a788b tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:09.454958 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a64d8d97-9596-4398-baac-36fc892a788b tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:09.455725 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-77c5b65c-83aa-45cd-a505-3a4a59d3e729 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:09.455855 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a64d8d97-9596-4398-baac-36fc892a788b tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:09.467156 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-77c5b65c-83aa-45cd-a505-3a4a59d3e729 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:09.469273 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-77c5b65c-83aa-45cd-a505-3a4a59d3e729 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:09.470740 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-77c5b65c-83aa-45cd-a505-3a4a59d3e729 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1407 microversion: 2.20 time: 0.391006 Jul 21 10:47:09.472202 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 62/134] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:47:09 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1407 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:47:09.479834 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-975d794d-76d3-480f-9928-327c0032cc43 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:47:09.480863 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-975d794d-76d3-480f-9928-327c0032cc43 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: 86715109-fd38-41f4-b384-a319c310fc44] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:47:09.490189 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-975d794d-76d3-480f-9928-327c0032cc43 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:09.493378 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-975d794d-76d3-480f-9928-327c0032cc43 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:09.500051 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-975d794d-76d3-480f-9928-327c0032cc43 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:09.500821 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-975d794d-76d3-480f-9928-327c0032cc43 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:09.902524 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-a64d8d97-9596-4398-baac-36fc892a788b tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906e4bc4e9cc45ecb01cfca7918e461d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc215aadb5345d791945658832aae4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:09.911479 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-a64d8d97-9596-4398-baac-36fc892a788b tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/691ae8fc-92e7-4940-99d8-7edb5a96d2f3" status: 200 len: 1367 microversion: 2.1 time: 0.476029 Jul 21 10:47:09.912066 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 73/135] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:47:09 2022] GET /compute/v2.1/servers/691ae8fc-92e7-4940-99d8-7edb5a96d2f3 => generated 1367 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:47:09.917631 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [req-765787f0-e8d9-499c-9ca6-98fb54dc620c req-e0cbf15d-237b-40f5-b5fc-02049303c21e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e730525-7ce4-4a5a-8023-84cae6b1da3d", "name": "network-vif-plugged", "status": "completed", "tag": "e0efd748-6569-4435-ab16-d9acccb72164"}]} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:47:09.925789 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-765787f0-e8d9-499c-9ca6-98fb54dc620c req-e0cbf15d-237b-40f5-b5fc-02049303c21e service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:09.926498 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-765787f0-e8d9-499c-9ca6-98fb54dc620c req-e0cbf15d-237b-40f5-b5fc-02049303c21e service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:09.939803 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-975d794d-76d3-480f-9928-327c0032cc43 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:09.939969 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.compute.server_external_events [req-765787f0-e8d9-499c-9ca6-98fb54dc620c req-e0cbf15d-237b-40f5-b5fc-02049303c21e service nova] Creating event network-vif-plugged:e0efd748-6569-4435-ab16-d9acccb72164 for instance 1e730525-7ce4-4a5a-8023-84cae6b1da3d on hv-cinder-84980 Jul 21 10:47:09.947135 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [req-765787f0-e8d9-499c-9ca6-98fb54dc620c req-e0cbf15d-237b-40f5-b5fc-02049303c21e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032376 Jul 21 10:47:09.948259 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 74/136] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 21 10:47:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:47:09.956051 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-975d794d-76d3-480f-9928-327c0032cc43 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44" status: 200 len: 1321 microversion: 2.1 time: 0.482538 Jul 21 10:47:09.956906 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 63/137] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:47:09 2022] GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44 => generated 1321 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:47:10.440149 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [req-3b8fce25-a79a-4771-a696-d7dc3a62f8e4 req-15ab2cd1-1c32-4429-a2c5-411960a77fab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "691ae8fc-92e7-4940-99d8-7edb5a96d2f3", "tag": "d85d0196-f957-408d-bc00-26b64629a630"}]} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:47:10.451127 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-e72b9618-8184-4657-987c-78b505e3a69b tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:47:10.452302 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-e72b9618-8184-4657-987c-78b505e3a69b tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] [instance: 2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:47:10.460180 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e72b9618-8184-4657-987c-78b505e3a69b tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:10.474579 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-3b8fce25-a79a-4771-a696-d7dc3a62f8e4 req-15ab2cd1-1c32-4429-a2c5-411960a77fab service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:10.475517 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e72b9618-8184-4657-987c-78b505e3a69b tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:10.477110 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e72b9618-8184-4657-987c-78b505e3a69b tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:10.479179 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e72b9618-8184-4657-987c-78b505e3a69b tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:10.484216 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-3b8fce25-a79a-4771-a696-d7dc3a62f8e4 req-15ab2cd1-1c32-4429-a2c5-411960a77fab service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:10.525114 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.compute.server_external_events [req-3b8fce25-a79a-4771-a696-d7dc3a62f8e4 req-15ab2cd1-1c32-4429-a2c5-411960a77fab service nova] Creating event network-changed:d85d0196-f957-408d-bc00-26b64629a630 for instance 691ae8fc-92e7-4940-99d8-7edb5a96d2f3 on hv-cinder-84980 Jul 21 10:47:10.545713 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [req-3b8fce25-a79a-4771-a696-d7dc3a62f8e4 req-15ab2cd1-1c32-4429-a2c5-411960a77fab service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109968 Jul 21 10:47:10.546394 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 75/138] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 21 10:47:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 10:47:10.589948 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-ea0dff9c-6378-4cdc-a8fd-b19d68f99feb tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:47:10.592377 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-ea0dff9c-6378-4cdc-a8fd-b19d68f99feb tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:47:10.613520 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ea0dff9c-6378-4cdc-a8fd-b19d68f99feb tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:10.614053 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ea0dff9c-6378-4cdc-a8fd-b19d68f99feb tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:10.620325 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ea0dff9c-6378-4cdc-a8fd-b19d68f99feb tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:10.621061 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ea0dff9c-6378-4cdc-a8fd-b19d68f99feb tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:10.785973 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-e72b9618-8184-4657-987c-78b505e3a69b tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7606b56fec4723b733f838ec34a17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceeabe5ea2a4a24b28901f50be5d532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:10.797895 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-e72b9618-8184-4657-987c-78b505e3a69b tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] 10.222.0.48 "GET /compute/v2.1/servers/2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985" status: 200 len: 1314 microversion: 2.1 time: 0.350787 Jul 21 10:47:10.798483 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 64/139] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:47:10 2022] GET /compute/v2.1/servers/2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985 => generated 1314 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:47:10.828594 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-ea0dff9c-6378-4cdc-a8fd-b19d68f99feb tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:10.837295 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-ea0dff9c-6378-4cdc-a8fd-b19d68f99feb tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:10.840138 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-ea0dff9c-6378-4cdc-a8fd-b19d68f99feb tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:10.840138 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-ea0dff9c-6378-4cdc-a8fd-b19d68f99feb tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1407 microversion: 2.20 time: 0.287691 Jul 21 10:47:10.840636 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 76/140] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:47:10 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1407 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:47:10.929391 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-936f9a84-e31b-438c-b469-ab4b44bec4a5 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:47:10.930597 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-936f9a84-e31b-438c-b469-ab4b44bec4a5 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 691ae8fc-92e7-4940-99d8-7edb5a96d2f3] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:47:10.936767 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-936f9a84-e31b-438c-b469-ab4b44bec4a5 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:10.937279 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-936f9a84-e31b-438c-b469-ab4b44bec4a5 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:10.938178 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-936f9a84-e31b-438c-b469-ab4b44bec4a5 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:10.938732 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-936f9a84-e31b-438c-b469-ab4b44bec4a5 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:10.982678 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-e5f775f3-27a9-4eab-92d9-b93b6624b12a tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:47:10.983564 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-e5f775f3-27a9-4eab-92d9-b93b6624b12a tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: 86715109-fd38-41f4-b384-a319c310fc44] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:47:10.990004 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e5f775f3-27a9-4eab-92d9-b93b6624b12a tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:10.990525 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e5f775f3-27a9-4eab-92d9-b93b6624b12a tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:10.991395 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e5f775f3-27a9-4eab-92d9-b93b6624b12a tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:10.991900 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e5f775f3-27a9-4eab-92d9-b93b6624b12a tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:10.999942 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell1:SELECT=100 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:47:11.123654 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-936f9a84-e31b-438c-b469-ab4b44bec4a5 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906e4bc4e9cc45ecb01cfca7918e461d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc215aadb5345d791945658832aae4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:11.131367 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-936f9a84-e31b-438c-b469-ab4b44bec4a5 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/691ae8fc-92e7-4940-99d8-7edb5a96d2f3" status: 200 len: 1367 microversion: 2.1 time: 0.205928 Jul 21 10:47:11.131939 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 65/141] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:47:10 2022] GET /compute/v2.1/servers/691ae8fc-92e7-4940-99d8-7edb5a96d2f3 => generated 1367 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:47:11.191859 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-e5f775f3-27a9-4eab-92d9-b93b6624b12a tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:11.205133 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-e5f775f3-27a9-4eab-92d9-b93b6624b12a tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44" status: 200 len: 1321 microversion: 2.1 time: 0.226942 Jul 21 10:47:11.206091 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 77/142] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:47:10 2022] GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44 => generated 1321 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:47:11.815556 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-fa3531ce-08e1-4b94-9273-8d3aa63bc19d tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:47:11.816759 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-fa3531ce-08e1-4b94-9273-8d3aa63bc19d tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] [instance: 2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:47:11.825588 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fa3531ce-08e1-4b94-9273-8d3aa63bc19d tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:11.826076 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fa3531ce-08e1-4b94-9273-8d3aa63bc19d tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:11.829900 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fa3531ce-08e1-4b94-9273-8d3aa63bc19d tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:11.829900 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fa3531ce-08e1-4b94-9273-8d3aa63bc19d tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:11.858626 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-10edb841-e3dc-4fb8-b4bf-f1820a5e5855 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:47:11.859877 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-10edb841-e3dc-4fb8-b4bf-f1820a5e5855 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:47:11.867057 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-10edb841-e3dc-4fb8-b4bf-f1820a5e5855 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:11.867891 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-10edb841-e3dc-4fb8-b4bf-f1820a5e5855 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:11.869419 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-10edb841-e3dc-4fb8-b4bf-f1820a5e5855 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:11.870118 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-10edb841-e3dc-4fb8-b4bf-f1820a5e5855 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:12.027524 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-fa3531ce-08e1-4b94-9273-8d3aa63bc19d tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7606b56fec4723b733f838ec34a17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceeabe5ea2a4a24b28901f50be5d532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:12.036043 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-fa3531ce-08e1-4b94-9273-8d3aa63bc19d tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] 10.222.0.48 "GET /compute/v2.1/servers/2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985" status: 200 len: 1314 microversion: 2.1 time: 0.224207 Jul 21 10:47:12.036631 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 66/143] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:47:11 2022] GET /compute/v2.1/servers/2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985 => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:47:12.054132 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-10edb841-e3dc-4fb8-b4bf-f1820a5e5855 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:12.062304 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-10edb841-e3dc-4fb8-b4bf-f1820a5e5855 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:12.063851 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-10edb841-e3dc-4fb8-b4bf-f1820a5e5855 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:12.064995 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-10edb841-e3dc-4fb8-b4bf-f1820a5e5855 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1407 microversion: 2.20 time: 0.210193 Jul 21 10:47:12.065505 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 78/144] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:47:11 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1407 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:47:12.149660 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-d454571e-585c-4227-8e00-0358f19dad8a tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:47:12.151047 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-d454571e-585c-4227-8e00-0358f19dad8a tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 691ae8fc-92e7-4940-99d8-7edb5a96d2f3] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:47:12.157236 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d454571e-585c-4227-8e00-0358f19dad8a tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:12.157657 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d454571e-585c-4227-8e00-0358f19dad8a tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:12.158411 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d454571e-585c-4227-8e00-0358f19dad8a tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:12.158988 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d454571e-585c-4227-8e00-0358f19dad8a tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:12.228465 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-aef33c6c-b8d8-4aad-bc32-b5801741085f tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:47:12.229141 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-aef33c6c-b8d8-4aad-bc32-b5801741085f tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: 86715109-fd38-41f4-b384-a319c310fc44] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:47:12.236771 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-aef33c6c-b8d8-4aad-bc32-b5801741085f tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:12.237324 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-aef33c6c-b8d8-4aad-bc32-b5801741085f tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:12.240223 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-aef33c6c-b8d8-4aad-bc32-b5801741085f tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:12.241444 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-aef33c6c-b8d8-4aad-bc32-b5801741085f tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:12.349683 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-d454571e-585c-4227-8e00-0358f19dad8a tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906e4bc4e9cc45ecb01cfca7918e461d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc215aadb5345d791945658832aae4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:12.356498 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell1:SELECT=100 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:47:12.361754 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-d454571e-585c-4227-8e00-0358f19dad8a tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/691ae8fc-92e7-4940-99d8-7edb5a96d2f3" status: 200 len: 1367 microversion: 2.1 time: 0.216620 Jul 21 10:47:12.378011 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 67/145] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:47:12 2022] GET /compute/v2.1/servers/691ae8fc-92e7-4940-99d8-7edb5a96d2f3 => generated 1367 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:47:12.397513 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-aef33c6c-b8d8-4aad-bc32-b5801741085f tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:12.405519 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-aef33c6c-b8d8-4aad-bc32-b5801741085f tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44" status: 200 len: 1321 microversion: 2.1 time: 0.180869 Jul 21 10:47:12.406095 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 79/146] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:47:12 2022] GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44 => generated 1321 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:47:13.056359 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-a86f764a-4f3e-460d-b2b4-b0c791fa5219 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:47:13.057979 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-a86f764a-4f3e-460d-b2b4-b0c791fa5219 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] [instance: 2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:47:13.072234 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a86f764a-4f3e-460d-b2b4-b0c791fa5219 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:13.072234 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a86f764a-4f3e-460d-b2b4-b0c791fa5219 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:13.072234 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a86f764a-4f3e-460d-b2b4-b0c791fa5219 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:13.072234 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a86f764a-4f3e-460d-b2b4-b0c791fa5219 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:13.084122 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-a3996141-0cb9-4cb6-b945-46ef748fc7a8 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:47:13.085283 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-a3996141-0cb9-4cb6-b945-46ef748fc7a8 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:47:13.092609 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a3996141-0cb9-4cb6-b945-46ef748fc7a8 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:13.093782 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a3996141-0cb9-4cb6-b945-46ef748fc7a8 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:13.094780 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a3996141-0cb9-4cb6-b945-46ef748fc7a8 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:13.095406 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a3996141-0cb9-4cb6-b945-46ef748fc7a8 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:13.337123 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-a86f764a-4f3e-460d-b2b4-b0c791fa5219 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7606b56fec4723b733f838ec34a17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceeabe5ea2a4a24b28901f50be5d532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:13.337123 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-a86f764a-4f3e-460d-b2b4-b0c791fa5219 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] 10.222.0.48 "GET /compute/v2.1/servers/2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985" status: 200 len: 1314 microversion: 2.1 time: 0.285865 Jul 21 10:47:13.337123 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 68/147] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:47:13 2022] GET /compute/v2.1/servers/2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985 => generated 1314 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:47:13.343592 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [req-2e27ea4c-4c65-4a09-901e-197e20d8e5bf req-1ed55c6c-627f-4dd6-849e-8ad19971ff49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86715109-fd38-41f4-b384-a319c310fc44", "name": "network-vif-plugged", "status": "completed", "tag": "2f00b65f-1c5b-4127-be24-1cea853f5f63"}]} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:47:13.351710 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-a3996141-0cb9-4cb6-b945-46ef748fc7a8 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:13.369088 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-2e27ea4c-4c65-4a09-901e-197e20d8e5bf req-1ed55c6c-627f-4dd6-849e-8ad19971ff49 service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:13.371964 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-2e27ea4c-4c65-4a09-901e-197e20d8e5bf req-1ed55c6c-627f-4dd6-849e-8ad19971ff49 service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:13.372933 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-a3996141-0cb9-4cb6-b945-46ef748fc7a8 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:13.374487 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-a3996141-0cb9-4cb6-b945-46ef748fc7a8 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:13.377261 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-a3996141-0cb9-4cb6-b945-46ef748fc7a8 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1407 microversion: 2.20 time: 0.297521 Jul 21 10:47:13.387957 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.compute.server_external_events [req-2e27ea4c-4c65-4a09-901e-197e20d8e5bf req-1ed55c6c-627f-4dd6-849e-8ad19971ff49 service nova] Creating event network-vif-plugged:2f00b65f-1c5b-4127-be24-1cea853f5f63 for instance 86715109-fd38-41f4-b384-a319c310fc44 on hv-cinder-84980 Jul 21 10:47:13.394729 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 80/148] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:47:13 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1407 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:47:13.397114 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [req-2e27ea4c-4c65-4a09-901e-197e20d8e5bf req-1ed55c6c-627f-4dd6-849e-8ad19971ff49 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060054 Jul 21 10:47:13.398267 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 69/149] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 21 10:47:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:47:13.413855 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-96883603-55a9-4b55-aaf1-70e0f7ef1aec tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:47:13.414472 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-96883603-55a9-4b55-aaf1-70e0f7ef1aec tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 691ae8fc-92e7-4940-99d8-7edb5a96d2f3] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:47:13.424857 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-b8e326a8-d088-4d98-9ec8-0c13ea97e5c1 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:47:13.425725 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-b8e326a8-d088-4d98-9ec8-0c13ea97e5c1 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: 86715109-fd38-41f4-b384-a319c310fc44] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:47:13.437458 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b8e326a8-d088-4d98-9ec8-0c13ea97e5c1 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:13.438150 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b8e326a8-d088-4d98-9ec8-0c13ea97e5c1 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:13.439146 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b8e326a8-d088-4d98-9ec8-0c13ea97e5c1 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:13.439767 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b8e326a8-d088-4d98-9ec8-0c13ea97e5c1 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:13.448659 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-96883603-55a9-4b55-aaf1-70e0f7ef1aec tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:13.449123 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-96883603-55a9-4b55-aaf1-70e0f7ef1aec tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:13.449866 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-96883603-55a9-4b55-aaf1-70e0f7ef1aec tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:13.450301 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-96883603-55a9-4b55-aaf1-70e0f7ef1aec tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:13.671746 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-b8e326a8-d088-4d98-9ec8-0c13ea97e5c1 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:13.679461 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-b8e326a8-d088-4d98-9ec8-0c13ea97e5c1 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44" status: 200 len: 1321 microversion: 2.1 time: 0.259669 Jul 21 10:47:13.680146 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 70/150] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:47:13 2022] GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44 => generated 1321 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:47:13.700051 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-96883603-55a9-4b55-aaf1-70e0f7ef1aec tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906e4bc4e9cc45ecb01cfca7918e461d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc215aadb5345d791945658832aae4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:13.707656 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-96883603-55a9-4b55-aaf1-70e0f7ef1aec tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/691ae8fc-92e7-4940-99d8-7edb5a96d2f3" status: 200 len: 1367 microversion: 2.1 time: 0.311630 Jul 21 10:47:13.708235 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 81/151] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:47:13 2022] GET /compute/v2.1/servers/691ae8fc-92e7-4940-99d8-7edb5a96d2f3 => generated 1367 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:47:14.353647 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-9334a716-4c38-4ada-8487-7a4a14fbb3c5 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:47:14.354372 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-9334a716-4c38-4ada-8487-7a4a14fbb3c5 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] [instance: 2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:47:14.360573 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9334a716-4c38-4ada-8487-7a4a14fbb3c5 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:14.361015 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9334a716-4c38-4ada-8487-7a4a14fbb3c5 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:14.361786 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9334a716-4c38-4ada-8487-7a4a14fbb3c5 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:14.362270 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9334a716-4c38-4ada-8487-7a4a14fbb3c5 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:14.405913 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-76d53434-d0b0-4d6f-82bd-1963c60cb4b8 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:47:14.407321 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-76d53434-d0b0-4d6f-82bd-1963c60cb4b8 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:47:14.417376 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-76d53434-d0b0-4d6f-82bd-1963c60cb4b8 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:14.418492 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-76d53434-d0b0-4d6f-82bd-1963c60cb4b8 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:14.419943 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-76d53434-d0b0-4d6f-82bd-1963c60cb4b8 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:14.420619 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-76d53434-d0b0-4d6f-82bd-1963c60cb4b8 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:14.627979 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-9334a716-4c38-4ada-8487-7a4a14fbb3c5 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7606b56fec4723b733f838ec34a17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceeabe5ea2a4a24b28901f50be5d532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:14.639447 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-9334a716-4c38-4ada-8487-7a4a14fbb3c5 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] 10.222.0.48 "GET /compute/v2.1/servers/2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985" status: 200 len: 1502 microversion: 2.1 time: 0.290296 Jul 21 10:47:14.640474 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 71/152] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:47:14 2022] GET /compute/v2.1/servers/2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985 => generated 1502 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:47:14.683754 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-76d53434-d0b0-4d6f-82bd-1963c60cb4b8 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:14.695379 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-76d53434-d0b0-4d6f-82bd-1963c60cb4b8 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:14.697350 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-76d53434-d0b0-4d6f-82bd-1963c60cb4b8 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:14.698699 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-76d53434-d0b0-4d6f-82bd-1963c60cb4b8 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1407 microversion: 2.20 time: 0.302728 Jul 21 10:47:14.699508 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 82/153] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:47:14 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1407 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:47:14.709913 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-f8d6e3ad-615d-4370-a4b8-12f2570ebda8 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:47:14.709913 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-f8d6e3ad-615d-4370-a4b8-12f2570ebda8 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: 86715109-fd38-41f4-b384-a319c310fc44] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:47:14.724625 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f8d6e3ad-615d-4370-a4b8-12f2570ebda8 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:14.725053 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f8d6e3ad-615d-4370-a4b8-12f2570ebda8 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:14.726143 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f8d6e3ad-615d-4370-a4b8-12f2570ebda8 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:14.726442 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f8d6e3ad-615d-4370-a4b8-12f2570ebda8 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:14.728575 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-422a9512-ca79-4204-94e6-caf96b0ab0b7 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:47:14.729192 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-422a9512-ca79-4204-94e6-caf96b0ab0b7 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 691ae8fc-92e7-4940-99d8-7edb5a96d2f3] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:47:14.736297 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-422a9512-ca79-4204-94e6-caf96b0ab0b7 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:14.737095 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-422a9512-ca79-4204-94e6-caf96b0ab0b7 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:14.739223 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-422a9512-ca79-4204-94e6-caf96b0ab0b7 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:14.740231 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-422a9512-ca79-4204-94e6-caf96b0ab0b7 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:14.987498 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-f8d6e3ad-615d-4370-a4b8-12f2570ebda8 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:14.989651 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-422a9512-ca79-4204-94e6-caf96b0ab0b7 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906e4bc4e9cc45ecb01cfca7918e461d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc215aadb5345d791945658832aae4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:14.996878 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-f8d6e3ad-615d-4370-a4b8-12f2570ebda8 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44" status: 200 len: 1321 microversion: 2.1 time: 0.303626 Jul 21 10:47:14.998098 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 72/154] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:47:14 2022] GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44 => generated 1321 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:47:14.998509 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-422a9512-ca79-4204-94e6-caf96b0ab0b7 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/691ae8fc-92e7-4940-99d8-7edb5a96d2f3" status: 200 len: 1367 microversion: 2.1 time: 0.274262 Jul 21 10:47:14.999325 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 83/155] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:47:14 2022] GET /compute/v2.1/servers/691ae8fc-92e7-4940-99d8-7edb5a96d2f3 => generated 1367 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:47:15.440033 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [req-22c11c2d-2946-466e-9496-f9695fdeadcf req-a8ee0cd4-4903-4732-bad7-6bcaa9a20e92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7a76827-1907-4bf4-b27c-945b33b2316d", "name": "network-vif-plugged", "status": "completed", "tag": "19e030a0-d846-4c1c-bab7-3d45644c2248"}]} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:47:15.459200 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-22c11c2d-2946-466e-9496-f9695fdeadcf req-a8ee0cd4-4903-4732-bad7-6bcaa9a20e92 service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:15.459647 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-22c11c2d-2946-466e-9496-f9695fdeadcf req-a8ee0cd4-4903-4732-bad7-6bcaa9a20e92 service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:15.487313 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.compute.server_external_events [req-22c11c2d-2946-466e-9496-f9695fdeadcf req-a8ee0cd4-4903-4732-bad7-6bcaa9a20e92 service nova] Creating event network-vif-plugged:19e030a0-d846-4c1c-bab7-3d45644c2248 for instance b7a76827-1907-4bf4-b27c-945b33b2316d on hv-cinder-84980 Jul 21 10:47:15.492991 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [req-22c11c2d-2946-466e-9496-f9695fdeadcf req-a8ee0cd4-4903-4732-bad7-6bcaa9a20e92 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059732 Jul 21 10:47:15.498107 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 73/156] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 21 10:47:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:47:15.720875 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-3eea085d-e72e-4937-8f81-94452c6bde1e tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:47:15.722979 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-3eea085d-e72e-4937-8f81-94452c6bde1e tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:47:15.732107 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3eea085d-e72e-4937-8f81-94452c6bde1e tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:15.732945 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3eea085d-e72e-4937-8f81-94452c6bde1e tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:15.735450 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3eea085d-e72e-4937-8f81-94452c6bde1e tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:15.736229 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3eea085d-e72e-4937-8f81-94452c6bde1e tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:15.984393 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-3eea085d-e72e-4937-8f81-94452c6bde1e tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:16.003039 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-3eea085d-e72e-4937-8f81-94452c6bde1e tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:16.004543 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-3eea085d-e72e-4937-8f81-94452c6bde1e tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:16.006898 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-3eea085d-e72e-4937-8f81-94452c6bde1e tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1598 microversion: 2.20 time: 0.293160 Jul 21 10:47:16.016286 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-d7500d2f-8d26-43be-bc4e-319a0b1139b1 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:47:16.016989 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-d7500d2f-8d26-43be-bc4e-319a0b1139b1 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: 86715109-fd38-41f4-b384-a319c310fc44] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:47:16.031215 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 84/157] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:47:15 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1598 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:47:16.031306 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d7500d2f-8d26-43be-bc4e-319a0b1139b1 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:16.031306 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d7500d2f-8d26-43be-bc4e-319a0b1139b1 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:16.031495 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d7500d2f-8d26-43be-bc4e-319a0b1139b1 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:16.032137 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d7500d2f-8d26-43be-bc4e-319a0b1139b1 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:16.037861 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-41cfc648-b28f-405a-b15f-038ed6e053e3 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:47:16.040125 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-41cfc648-b28f-405a-b15f-038ed6e053e3 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 691ae8fc-92e7-4940-99d8-7edb5a96d2f3] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:47:16.046938 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-41cfc648-b28f-405a-b15f-038ed6e053e3 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:16.047390 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-41cfc648-b28f-405a-b15f-038ed6e053e3 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:16.048159 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-41cfc648-b28f-405a-b15f-038ed6e053e3 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:16.048815 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-41cfc648-b28f-405a-b15f-038ed6e053e3 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:16.258141 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-d7500d2f-8d26-43be-bc4e-319a0b1139b1 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:16.269407 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-d7500d2f-8d26-43be-bc4e-319a0b1139b1 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44" status: 200 len: 1321 microversion: 2.1 time: 0.257950 Jul 21 10:47:16.270353 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 74/158] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:47:16 2022] GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44 => generated 1321 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:47:16.275908 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-780bc2fa-39c2-495f-b216-421a3a48c717 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:47:16.277353 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-780bc2fa-39c2-495f-b216-421a3a48c717 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:47:16.283923 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-780bc2fa-39c2-495f-b216-421a3a48c717 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:16.284654 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-780bc2fa-39c2-495f-b216-421a3a48c717 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:16.285635 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-780bc2fa-39c2-495f-b216-421a3a48c717 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:16.286069 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-780bc2fa-39c2-495f-b216-421a3a48c717 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:16.316319 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-41cfc648-b28f-405a-b15f-038ed6e053e3 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906e4bc4e9cc45ecb01cfca7918e461d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc215aadb5345d791945658832aae4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:16.329660 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-41cfc648-b28f-405a-b15f-038ed6e053e3 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/691ae8fc-92e7-4940-99d8-7edb5a96d2f3" status: 200 len: 1367 microversion: 2.1 time: 0.298599 Jul 21 10:47:16.333428 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 85/159] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:47:16 2022] GET /compute/v2.1/servers/691ae8fc-92e7-4940-99d8-7edb5a96d2f3 => generated 1367 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:47:16.470075 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-780bc2fa-39c2-495f-b216-421a3a48c717 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.198328 Jul 21 10:47:16.470676 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 75/160] 10.222.0.48 () {60 vars in 1315 bytes} [Thu Jul 21 10:47:16 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d/os-interface => generated 284 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 10:47:16.702352 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-b10bc3ea-61af-413b-9c6c-024b782e9b47 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a7648d6d-499c-46c7-86cd-4f365f36c6ae"}} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:47:16.703849 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-b10bc3ea-61af-413b-9c6c-024b782e9b47 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] [instance: 2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:47:16.715428 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b10bc3ea-61af-413b-9c6c-024b782e9b47 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:16.721135 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b10bc3ea-61af-413b-9c6c-024b782e9b47 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:16.723395 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b10bc3ea-61af-413b-9c6c-024b782e9b47 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:16.723904 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b10bc3ea-61af-413b-9c6c-024b782e9b47 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:17.287732 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-1e8fe7b0-68e6-42d1-9958-c257fd3f88ee tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:47:17.288654 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-1e8fe7b0-68e6-42d1-9958-c257fd3f88ee tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: 86715109-fd38-41f4-b384-a319c310fc44] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:47:17.296207 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1e8fe7b0-68e6-42d1-9958-c257fd3f88ee tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:17.296732 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1e8fe7b0-68e6-42d1-9958-c257fd3f88ee tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:17.297831 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1e8fe7b0-68e6-42d1-9958-c257fd3f88ee tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:17.298709 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1e8fe7b0-68e6-42d1-9958-c257fd3f88ee tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:17.854956 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-1e8fe7b0-68e6-42d1-9958-c257fd3f88ee tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:17.864808 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-1e8fe7b0-68e6-42d1-9958-c257fd3f88ee tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44" status: 200 len: 1321 microversion: 2.1 time: 0.581424 Jul 21 10:47:17.867871 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 76/161] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:47:17 2022] GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44 => generated 1321 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:47:17.875199 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-198e0ea3-d5ea-4c80-9bef-fcb77877bcba tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:47:17.887477 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-198e0ea3-d5ea-4c80-9bef-fcb77877bcba tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 691ae8fc-92e7-4940-99d8-7edb5a96d2f3] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:47:17.902136 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-198e0ea3-d5ea-4c80-9bef-fcb77877bcba tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:17.902601 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-198e0ea3-d5ea-4c80-9bef-fcb77877bcba tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:17.903580 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-198e0ea3-d5ea-4c80-9bef-fcb77877bcba tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:17.904016 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-198e0ea3-d5ea-4c80-9bef-fcb77877bcba tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:18.159853 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-198e0ea3-d5ea-4c80-9bef-fcb77877bcba tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906e4bc4e9cc45ecb01cfca7918e461d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc215aadb5345d791945658832aae4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:18.168669 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-198e0ea3-d5ea-4c80-9bef-fcb77877bcba tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/691ae8fc-92e7-4940-99d8-7edb5a96d2f3" status: 200 len: 1367 microversion: 2.1 time: 0.297071 Jul 21 10:47:18.169694 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 77/162] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:47:17 2022] GET /compute/v2.1/servers/691ae8fc-92e7-4940-99d8-7edb5a96d2f3 => generated 1367 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:47:18.233214 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-b10bc3ea-61af-413b-9c6c-024b782e9b47 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] 10.222.0.48 "POST /compute/v2.1/servers/2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.535568 Jul 21 10:47:18.235375 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 86/163] 10.222.0.48 () {60 vars in 1322 bytes} [Thu Jul 21 10:47:16 2022] POST /compute/v2.1/servers/2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985/os-volume_attachments => generated 194 bytes in 1540 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:47:18.546273 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [req-17052c28-94ec-43c1-bf79-87e5b8bfd9a1 req-4428422d-7230-47e4-80d0-0d3f2137aa9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e730525-7ce4-4a5a-8023-84cae6b1da3d", "tag": "e0efd748-6569-4435-ab16-d9acccb72164"}]} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:47:18.557656 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-17052c28-94ec-43c1-bf79-87e5b8bfd9a1 req-4428422d-7230-47e4-80d0-0d3f2137aa9c service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:18.557656 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-17052c28-94ec-43c1-bf79-87e5b8bfd9a1 req-4428422d-7230-47e4-80d0-0d3f2137aa9c service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:18.569111 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.compute.server_external_events [req-17052c28-94ec-43c1-bf79-87e5b8bfd9a1 req-4428422d-7230-47e4-80d0-0d3f2137aa9c service nova] Creating event network-changed:e0efd748-6569-4435-ab16-d9acccb72164 for instance 1e730525-7ce4-4a5a-8023-84cae6b1da3d on hv-cinder-84980 Jul 21 10:47:18.577067 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [req-17052c28-94ec-43c1-bf79-87e5b8bfd9a1 req-4428422d-7230-47e4-80d0-0d3f2137aa9c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034236 Jul 21 10:47:18.577905 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 78/164] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 21 10:47:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 10:47:18.890207 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-6b09330c-3f84-4d82-9162-46709ed9a040 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:47:18.892192 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-6b09330c-3f84-4d82-9162-46709ed9a040 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: 86715109-fd38-41f4-b384-a319c310fc44] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:47:18.901675 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6b09330c-3f84-4d82-9162-46709ed9a040 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:18.902615 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6b09330c-3f84-4d82-9162-46709ed9a040 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:18.903412 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6b09330c-3f84-4d82-9162-46709ed9a040 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:18.903846 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6b09330c-3f84-4d82-9162-46709ed9a040 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:19.070693 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-6b09330c-3f84-4d82-9162-46709ed9a040 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:19.078696 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-6b09330c-3f84-4d82-9162-46709ed9a040 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44" status: 200 len: 1516 microversion: 2.1 time: 0.195790 Jul 21 10:47:19.089524 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 87/165] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:47:18 2022] GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44 => generated 1516 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:47:19.101513 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-684d15ed-6153-4fc6-8fdb-7cbc4197c472 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:47:19.103483 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-684d15ed-6153-4fc6-8fdb-7cbc4197c472 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: 86715109-fd38-41f4-b384-a319c310fc44] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:47:19.111073 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-684d15ed-6153-4fc6-8fdb-7cbc4197c472 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:19.111610 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-684d15ed-6153-4fc6-8fdb-7cbc4197c472 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:19.112951 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-684d15ed-6153-4fc6-8fdb-7cbc4197c472 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:19.113601 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-684d15ed-6153-4fc6-8fdb-7cbc4197c472 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:19.139859 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.objects.instance [None req-684d15ed-6153-4fc6-8fdb-7cbc4197c472 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lazy-loading 'flavor' on Instance uuid 86715109-fd38-41f4-b384-a319c310fc44 {{(pid=124867) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 10:47:19.195483 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-00ab0567-9213-457c-a331-51814b334c27 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:47:19.202414 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-00ab0567-9213-457c-a331-51814b334c27 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 691ae8fc-92e7-4940-99d8-7edb5a96d2f3] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:47:19.210764 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-00ab0567-9213-457c-a331-51814b334c27 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:19.211672 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-00ab0567-9213-457c-a331-51814b334c27 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:19.217993 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-00ab0567-9213-457c-a331-51814b334c27 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:19.218491 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-00ab0567-9213-457c-a331-51814b334c27 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:19.423101 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-00ab0567-9213-457c-a331-51814b334c27 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906e4bc4e9cc45ecb01cfca7918e461d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc215aadb5345d791945658832aae4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:19.437532 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-00ab0567-9213-457c-a331-51814b334c27 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/691ae8fc-92e7-4940-99d8-7edb5a96d2f3" status: 200 len: 1367 microversion: 2.1 time: 0.248004 Jul 21 10:47:19.444618 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 88/166] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:47:19 2022] GET /compute/v2.1/servers/691ae8fc-92e7-4940-99d8-7edb5a96d2f3 => generated 1367 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:47:19.489026 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-684d15ed-6153-4fc6-8fdb-7cbc4197c472 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "POST /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44/action" status: 200 len: 32 microversion: 2.1 time: 0.392107 Jul 21 10:47:19.490010 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 79/167] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 21 10:47:19 2022] POST /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44/action => generated 32 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 21 10:47:19.501406 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-d60839be-2f08-4c25-ac99-1486bcc2ef4a tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:47:19.502038 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-d60839be-2f08-4c25-ac99-1486bcc2ef4a tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: 86715109-fd38-41f4-b384-a319c310fc44] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:47:19.515270 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d60839be-2f08-4c25-ac99-1486bcc2ef4a tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:19.517056 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d60839be-2f08-4c25-ac99-1486bcc2ef4a tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:19.518192 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d60839be-2f08-4c25-ac99-1486bcc2ef4a tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:19.520088 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d60839be-2f08-4c25-ac99-1486bcc2ef4a tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:19.730755 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-d60839be-2f08-4c25-ac99-1486bcc2ef4a tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:19.758041 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-d60839be-2f08-4c25-ac99-1486bcc2ef4a tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44" status: 200 len: 1522 microversion: 2.1 time: 0.261847 Jul 21 10:47:19.759667 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 89/168] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:47:19 2022] GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44 => generated 1522 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:47:20.460851 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-a8c6471d-a94f-4f91-be3f-111272d5c5cf tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:47:20.461549 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-a8c6471d-a94f-4f91-be3f-111272d5c5cf tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 691ae8fc-92e7-4940-99d8-7edb5a96d2f3] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:47:20.475605 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a8c6471d-a94f-4f91-be3f-111272d5c5cf tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:20.475848 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a8c6471d-a94f-4f91-be3f-111272d5c5cf tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:20.476820 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a8c6471d-a94f-4f91-be3f-111272d5c5cf tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:20.477430 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a8c6471d-a94f-4f91-be3f-111272d5c5cf tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:20.678327 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-a8c6471d-a94f-4f91-be3f-111272d5c5cf tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906e4bc4e9cc45ecb01cfca7918e461d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc215aadb5345d791945658832aae4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:20.687590 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-a8c6471d-a94f-4f91-be3f-111272d5c5cf tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/691ae8fc-92e7-4940-99d8-7edb5a96d2f3" status: 200 len: 1367 microversion: 2.1 time: 0.230522 Jul 21 10:47:20.688978 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 80/169] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:47:20 2022] GET /compute/v2.1/servers/691ae8fc-92e7-4940-99d8-7edb5a96d2f3 => generated 1367 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:47:20.779696 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-d2dc9579-5e67-49a3-8d82-bc90be88a088 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:47:20.780421 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-d2dc9579-5e67-49a3-8d82-bc90be88a088 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: 86715109-fd38-41f4-b384-a319c310fc44] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:47:20.790888 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d2dc9579-5e67-49a3-8d82-bc90be88a088 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:20.790888 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d2dc9579-5e67-49a3-8d82-bc90be88a088 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:20.790888 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d2dc9579-5e67-49a3-8d82-bc90be88a088 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:20.790888 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d2dc9579-5e67-49a3-8d82-bc90be88a088 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:20.963570 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-d2dc9579-5e67-49a3-8d82-bc90be88a088 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:20.973321 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-d2dc9579-5e67-49a3-8d82-bc90be88a088 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44" status: 200 len: 1522 microversion: 2.1 time: 0.197338 Jul 21 10:47:20.974044 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 90/170] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:47:20 2022] GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44 => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:47:21.705410 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-1e93cc6f-359c-4e47-ab60-2c71322953ed tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:47:21.706626 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-1e93cc6f-359c-4e47-ab60-2c71322953ed tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 691ae8fc-92e7-4940-99d8-7edb5a96d2f3] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:47:21.708606 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_api:SELECT=97 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:47:21.714851 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1e93cc6f-359c-4e47-ab60-2c71322953ed tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:21.715553 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1e93cc6f-359c-4e47-ab60-2c71322953ed tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:21.716825 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1e93cc6f-359c-4e47-ab60-2c71322953ed tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:21.717263 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1e93cc6f-359c-4e47-ab60-2c71322953ed tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:21.917327 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-1e93cc6f-359c-4e47-ab60-2c71322953ed tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906e4bc4e9cc45ecb01cfca7918e461d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc215aadb5345d791945658832aae4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:21.935166 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-1e93cc6f-359c-4e47-ab60-2c71322953ed tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/691ae8fc-92e7-4940-99d8-7edb5a96d2f3" status: 200 len: 1367 microversion: 2.1 time: 0.232409 Jul 21 10:47:21.937118 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 81/171] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:47:21 2022] GET /compute/v2.1/servers/691ae8fc-92e7-4940-99d8-7edb5a96d2f3 => generated 1367 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:47:21.991270 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-faa69d63-9fdc-4d1b-914f-7e57e453afb5 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:47:21.992206 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-faa69d63-9fdc-4d1b-914f-7e57e453afb5 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: 86715109-fd38-41f4-b384-a319c310fc44] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:47:21.995451 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_api:SELECT=96 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:47:22.000511 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-faa69d63-9fdc-4d1b-914f-7e57e453afb5 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:22.001162 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-faa69d63-9fdc-4d1b-914f-7e57e453afb5 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:22.001936 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-faa69d63-9fdc-4d1b-914f-7e57e453afb5 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:22.002361 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-faa69d63-9fdc-4d1b-914f-7e57e453afb5 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:22.189638 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-faa69d63-9fdc-4d1b-914f-7e57e453afb5 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:22.200847 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-faa69d63-9fdc-4d1b-914f-7e57e453afb5 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44" status: 200 len: 1522 microversion: 2.1 time: 0.213075 Jul 21 10:47:22.202186 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 91/172] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:47:21 2022] GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44 => generated 1522 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:47:22.953574 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-27ecd124-423a-42d1-a1a7-2f785fe20450 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:47:22.954170 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-27ecd124-423a-42d1-a1a7-2f785fe20450 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 691ae8fc-92e7-4940-99d8-7edb5a96d2f3] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:47:22.965810 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-27ecd124-423a-42d1-a1a7-2f785fe20450 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:22.969776 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-27ecd124-423a-42d1-a1a7-2f785fe20450 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:22.970947 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-27ecd124-423a-42d1-a1a7-2f785fe20450 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:22.973926 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-27ecd124-423a-42d1-a1a7-2f785fe20450 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:23.187885 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-27ecd124-423a-42d1-a1a7-2f785fe20450 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906e4bc4e9cc45ecb01cfca7918e461d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc215aadb5345d791945658832aae4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:23.199727 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-27ecd124-423a-42d1-a1a7-2f785fe20450 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/691ae8fc-92e7-4940-99d8-7edb5a96d2f3" status: 200 len: 1367 microversion: 2.1 time: 0.250472 Jul 21 10:47:23.200849 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 82/173] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:47:22 2022] GET /compute/v2.1/servers/691ae8fc-92e7-4940-99d8-7edb5a96d2f3 => generated 1367 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:47:23.228913 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [req-af135b21-c30d-4640-97dc-42e55161beeb req-98bbf6ac-bc7d-4fe2-8346-e7d8fbffc996 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "691ae8fc-92e7-4940-99d8-7edb5a96d2f3", "name": "network-vif-plugged", "status": "completed", "tag": "d85d0196-f957-408d-bc00-26b64629a630"}]} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:47:23.229404 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-3bd5d862-6fc5-4b44-98d0-c985a563b8c3 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:47:23.230155 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-3bd5d862-6fc5-4b44-98d0-c985a563b8c3 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: 86715109-fd38-41f4-b384-a319c310fc44] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:47:23.239048 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3bd5d862-6fc5-4b44-98d0-c985a563b8c3 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:23.239498 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3bd5d862-6fc5-4b44-98d0-c985a563b8c3 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:23.240664 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3bd5d862-6fc5-4b44-98d0-c985a563b8c3 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:23.241148 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3bd5d862-6fc5-4b44-98d0-c985a563b8c3 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:23.270517 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-af135b21-c30d-4640-97dc-42e55161beeb req-98bbf6ac-bc7d-4fe2-8346-e7d8fbffc996 service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:23.271006 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-af135b21-c30d-4640-97dc-42e55161beeb req-98bbf6ac-bc7d-4fe2-8346-e7d8fbffc996 service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:23.307530 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.compute.server_external_events [req-af135b21-c30d-4640-97dc-42e55161beeb req-98bbf6ac-bc7d-4fe2-8346-e7d8fbffc996 service nova] Creating event network-vif-plugged:d85d0196-f957-408d-bc00-26b64629a630 for instance 691ae8fc-92e7-4940-99d8-7edb5a96d2f3 on hv-cinder-84980 Jul 21 10:47:23.313283 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [req-af135b21-c30d-4640-97dc-42e55161beeb req-98bbf6ac-bc7d-4fe2-8346-e7d8fbffc996 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101260 Jul 21 10:47:23.317067 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 92/174] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 21 10:47:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:47:23.504462 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-3bd5d862-6fc5-4b44-98d0-c985a563b8c3 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:23.515292 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-3bd5d862-6fc5-4b44-98d0-c985a563b8c3 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44" status: 200 len: 1522 microversion: 2.1 time: 0.290479 Jul 21 10:47:23.515876 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 83/175] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:47:23 2022] GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44 => generated 1522 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:47:24.221952 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-4ef14f41-8901-4c71-9929-70b6e6b52ee8 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:47:24.222662 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-4ef14f41-8901-4c71-9929-70b6e6b52ee8 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 691ae8fc-92e7-4940-99d8-7edb5a96d2f3] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:47:24.229994 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4ef14f41-8901-4c71-9929-70b6e6b52ee8 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:24.230847 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4ef14f41-8901-4c71-9929-70b6e6b52ee8 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:24.231244 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4ef14f41-8901-4c71-9929-70b6e6b52ee8 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:24.231677 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4ef14f41-8901-4c71-9929-70b6e6b52ee8 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:24.236035 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:47:24.381793 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-4ef14f41-8901-4c71-9929-70b6e6b52ee8 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906e4bc4e9cc45ecb01cfca7918e461d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc215aadb5345d791945658832aae4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:24.392871 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-4ef14f41-8901-4c71-9929-70b6e6b52ee8 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/691ae8fc-92e7-4940-99d8-7edb5a96d2f3" status: 200 len: 1367 microversion: 2.1 time: 0.178364 Jul 21 10:47:24.393473 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 93/176] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:47:24 2022] GET /compute/v2.1/servers/691ae8fc-92e7-4940-99d8-7edb5a96d2f3 => generated 1367 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:47:24.532794 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-d9004727-3028-42de-b19f-ef5680939150 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:47:24.534051 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-d9004727-3028-42de-b19f-ef5680939150 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: 86715109-fd38-41f4-b384-a319c310fc44] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:47:24.542598 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d9004727-3028-42de-b19f-ef5680939150 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:24.542598 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d9004727-3028-42de-b19f-ef5680939150 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:24.543347 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d9004727-3028-42de-b19f-ef5680939150 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:24.543792 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d9004727-3028-42de-b19f-ef5680939150 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:24.690639 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-d9004727-3028-42de-b19f-ef5680939150 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:24.694045 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:47:24.699560 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-d9004727-3028-42de-b19f-ef5680939150 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44" status: 200 len: 1522 microversion: 2.1 time: 0.170301 Jul 21 10:47:24.700400 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 84/177] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:47:24 2022] GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:47:25.420579 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-b8d6396e-6f61-4da6-9750-bcbd07ef2253 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:47:25.421946 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-b8d6396e-6f61-4da6-9750-bcbd07ef2253 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 691ae8fc-92e7-4940-99d8-7edb5a96d2f3] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:47:25.431487 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b8d6396e-6f61-4da6-9750-bcbd07ef2253 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:25.431849 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b8d6396e-6f61-4da6-9750-bcbd07ef2253 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:25.432995 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b8d6396e-6f61-4da6-9750-bcbd07ef2253 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:25.433590 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b8d6396e-6f61-4da6-9750-bcbd07ef2253 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:25.576828 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-b8d6396e-6f61-4da6-9750-bcbd07ef2253 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906e4bc4e9cc45ecb01cfca7918e461d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc215aadb5345d791945658832aae4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:25.594637 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-b8d6396e-6f61-4da6-9750-bcbd07ef2253 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/691ae8fc-92e7-4940-99d8-7edb5a96d2f3" status: 200 len: 1367 microversion: 2.1 time: 0.169088 Jul 21 10:47:25.594637 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 94/178] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:47:25 2022] GET /compute/v2.1/servers/691ae8fc-92e7-4940-99d8-7edb5a96d2f3 => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:47:25.717503 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-7a799016-8675-4c90-88cd-f36c46d067d8 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:47:25.718124 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-7a799016-8675-4c90-88cd-f36c46d067d8 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: 86715109-fd38-41f4-b384-a319c310fc44] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:47:25.726617 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7a799016-8675-4c90-88cd-f36c46d067d8 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:25.727148 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7a799016-8675-4c90-88cd-f36c46d067d8 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:25.728064 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7a799016-8675-4c90-88cd-f36c46d067d8 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:25.729024 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7a799016-8675-4c90-88cd-f36c46d067d8 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:25.871127 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-7a799016-8675-4c90-88cd-f36c46d067d8 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:25.878565 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-7a799016-8675-4c90-88cd-f36c46d067d8 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44" status: 200 len: 1522 microversion: 2.1 time: 0.166611 Jul 21 10:47:25.879154 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 85/179] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:47:25 2022] GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:47:26.602129 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-6beeb667-6f31-4512-b5e9-8d170dc004aa tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:47:26.603019 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-6beeb667-6f31-4512-b5e9-8d170dc004aa tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 691ae8fc-92e7-4940-99d8-7edb5a96d2f3] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:47:26.610429 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6beeb667-6f31-4512-b5e9-8d170dc004aa tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:26.610974 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6beeb667-6f31-4512-b5e9-8d170dc004aa tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:26.611822 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6beeb667-6f31-4512-b5e9-8d170dc004aa tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:26.612316 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6beeb667-6f31-4512-b5e9-8d170dc004aa tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:26.747846 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-6beeb667-6f31-4512-b5e9-8d170dc004aa tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906e4bc4e9cc45ecb01cfca7918e461d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc215aadb5345d791945658832aae4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:26.755493 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-6beeb667-6f31-4512-b5e9-8d170dc004aa tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/691ae8fc-92e7-4940-99d8-7edb5a96d2f3" status: 200 len: 1558 microversion: 2.1 time: 0.157213 Jul 21 10:47:26.756077 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 95/180] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:47:26 2022] GET /compute/v2.1/servers/691ae8fc-92e7-4940-99d8-7edb5a96d2f3 => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:47:26.775721 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-5c9a0501-1883-40bc-9431-f194dcee1297 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:47:26.776273 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-5c9a0501-1883-40bc-9431-f194dcee1297 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 691ae8fc-92e7-4940-99d8-7edb5a96d2f3] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:47:26.784429 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5c9a0501-1883-40bc-9431-f194dcee1297 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:26.784429 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5c9a0501-1883-40bc-9431-f194dcee1297 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:26.784429 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5c9a0501-1883-40bc-9431-f194dcee1297 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:26.784652 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5c9a0501-1883-40bc-9431-f194dcee1297 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:26.862969 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-5c9a0501-1883-40bc-9431-f194dcee1297 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/691ae8fc-92e7-4940-99d8-7edb5a96d2f3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091915 Jul 21 10:47:26.863568 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 86/181] 10.222.0.48 () {58 vars in 1274 bytes} [Thu Jul 21 10:47:26 2022] GET /compute/v2.1/servers/691ae8fc-92e7-4940-99d8-7edb5a96d2f3/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 10:47:26.896103 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-a071c1ab-11bf-4e31-a280-a219f1b6f3d3 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:47:26.896715 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-a071c1ab-11bf-4e31-a280-a219f1b6f3d3 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: 86715109-fd38-41f4-b384-a319c310fc44] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:47:26.903375 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a071c1ab-11bf-4e31-a280-a219f1b6f3d3 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:26.903832 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a071c1ab-11bf-4e31-a280-a219f1b6f3d3 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:26.904598 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a071c1ab-11bf-4e31-a280-a219f1b6f3d3 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:26.905029 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a071c1ab-11bf-4e31-a280-a219f1b6f3d3 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:27.152856 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-a071c1ab-11bf-4e31-a280-a219f1b6f3d3 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:27.174633 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-a071c1ab-11bf-4e31-a280-a219f1b6f3d3 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44" status: 200 len: 1522 microversion: 2.1 time: 0.282237 Jul 21 10:47:27.175867 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 96/182] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:47:26 2022] GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44 => generated 1522 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:47:28.191255 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-14122592-f5ee-4604-b3cd-f04493fa7525 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:47:28.194536 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-14122592-f5ee-4604-b3cd-f04493fa7525 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: 86715109-fd38-41f4-b384-a319c310fc44] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:47:28.199079 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-14122592-f5ee-4604-b3cd-f04493fa7525 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:28.199518 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-14122592-f5ee-4604-b3cd-f04493fa7525 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:28.200279 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-14122592-f5ee-4604-b3cd-f04493fa7525 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:28.200703 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-14122592-f5ee-4604-b3cd-f04493fa7525 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:28.336080 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [req-7705aae4-59aa-4185-bb02-d6136b33ae75 req-84540d2f-6f91-4f52-8c4a-36d22b0537bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "691ae8fc-92e7-4940-99d8-7edb5a96d2f3", "tag": "d85d0196-f957-408d-bc00-26b64629a630"}]} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:47:28.350071 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-7705aae4-59aa-4185-bb02-d6136b33ae75 req-84540d2f-6f91-4f52-8c4a-36d22b0537bb service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:28.351112 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-7705aae4-59aa-4185-bb02-d6136b33ae75 req-84540d2f-6f91-4f52-8c4a-36d22b0537bb service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:28.365612 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.compute.server_external_events [req-7705aae4-59aa-4185-bb02-d6136b33ae75 req-84540d2f-6f91-4f52-8c4a-36d22b0537bb service nova] Creating event network-changed:d85d0196-f957-408d-bc00-26b64629a630 for instance 691ae8fc-92e7-4940-99d8-7edb5a96d2f3 on hv-cinder-84980 Jul 21 10:47:28.375529 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [req-7705aae4-59aa-4185-bb02-d6136b33ae75 req-84540d2f-6f91-4f52-8c4a-36d22b0537bb service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043579 Jul 21 10:47:28.376956 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 97/183] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 21 10:47:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:47:28.407469 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-14122592-f5ee-4604-b3cd-f04493fa7525 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:28.416925 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-14122592-f5ee-4604-b3cd-f04493fa7525 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44" status: 200 len: 1522 microversion: 2.1 time: 0.229483 Jul 21 10:47:28.418270 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 87/184] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:47:28 2022] GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44 => generated 1522 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:47:29.450813 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-a0dd5650-9834-4816-a199-9807f8e8cd8c tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:47:29.450813 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-a0dd5650-9834-4816-a199-9807f8e8cd8c tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: 86715109-fd38-41f4-b384-a319c310fc44] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:47:29.458051 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a0dd5650-9834-4816-a199-9807f8e8cd8c tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:29.458770 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a0dd5650-9834-4816-a199-9807f8e8cd8c tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:29.467856 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a0dd5650-9834-4816-a199-9807f8e8cd8c tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:29.468674 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a0dd5650-9834-4816-a199-9807f8e8cd8c tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:29.691782 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-a0dd5650-9834-4816-a199-9807f8e8cd8c tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:29.706306 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-a0dd5650-9834-4816-a199-9807f8e8cd8c tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44" status: 200 len: 1522 microversion: 2.1 time: 0.273123 Jul 21 10:47:29.735476 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 98/185] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:47:29 2022] GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44 => generated 1522 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:47:30.221467 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-a5bf541b-3673-4ebe-8dca-cbe4b6890f79 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:47:30.222031 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-a5bf541b-3673-4ebe-8dca-cbe4b6890f79 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] [instance: 2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:47:30.229038 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a5bf541b-3673-4ebe-8dca-cbe4b6890f79 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:30.229493 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a5bf541b-3673-4ebe-8dca-cbe4b6890f79 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:30.230269 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a5bf541b-3673-4ebe-8dca-cbe4b6890f79 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:30.230731 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a5bf541b-3673-4ebe-8dca-cbe4b6890f79 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:30.257970 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-a5bf541b-3673-4ebe-8dca-cbe4b6890f79 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] [instance: 2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985] Going to try to terminate instance {{(pid=124867) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 10:47:30.508085 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-a5bf541b-3673-4ebe-8dca-cbe4b6890f79 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] 10.222.0.48 "DELETE /compute/v2.1/servers/2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985" status: 204 len: 0 microversion: 2.1 time: 0.290206 Jul 21 10:47:30.513987 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 88/186] 10.222.0.48 () {58 vars in 1238 bytes} [Thu Jul 21 10:47:30 2022] DELETE /compute/v2.1/servers/2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 10:47:30.522036 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-c3ab2fdc-39fb-4d59-9cc8-17cd57c87669 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:47:30.527130 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-c3ab2fdc-39fb-4d59-9cc8-17cd57c87669 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] [instance: 2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:47:30.536641 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c3ab2fdc-39fb-4d59-9cc8-17cd57c87669 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:30.537681 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c3ab2fdc-39fb-4d59-9cc8-17cd57c87669 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:30.538813 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c3ab2fdc-39fb-4d59-9cc8-17cd57c87669 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:30.539445 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c3ab2fdc-39fb-4d59-9cc8-17cd57c87669 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:30.689198 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-c3ab2fdc-39fb-4d59-9cc8-17cd57c87669 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7606b56fec4723b733f838ec34a17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceeabe5ea2a4a24b28901f50be5d532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:30.698285 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-c3ab2fdc-39fb-4d59-9cc8-17cd57c87669 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] 10.222.0.48 "GET /compute/v2.1/servers/2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985" status: 200 len: 1554 microversion: 2.1 time: 0.182869 Jul 21 10:47:30.698962 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 99/187] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:47:30 2022] GET /compute/v2.1/servers/2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985 => generated 1554 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:47:30.725588 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-d3d440e1-b0de-4276-9985-8f9eda9849e4 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:47:30.726281 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-d3d440e1-b0de-4276-9985-8f9eda9849e4 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: 86715109-fd38-41f4-b384-a319c310fc44] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:47:30.732693 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d3d440e1-b0de-4276-9985-8f9eda9849e4 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:30.733184 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d3d440e1-b0de-4276-9985-8f9eda9849e4 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:30.733970 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d3d440e1-b0de-4276-9985-8f9eda9849e4 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:30.734385 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d3d440e1-b0de-4276-9985-8f9eda9849e4 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:30.881521 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-d3d440e1-b0de-4276-9985-8f9eda9849e4 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:30.891552 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-d3d440e1-b0de-4276-9985-8f9eda9849e4 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44" status: 200 len: 1522 microversion: 2.1 time: 0.170452 Jul 21 10:47:30.892670 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 89/188] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:47:30 2022] GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:47:31.715991 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-e60ce1bd-b170-401a-bc74-ca721613e0da tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:47:31.716710 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-e60ce1bd-b170-401a-bc74-ca721613e0da tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] [instance: 2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:47:31.723799 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e60ce1bd-b170-401a-bc74-ca721613e0da tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:31.724240 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e60ce1bd-b170-401a-bc74-ca721613e0da tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:31.728055 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e60ce1bd-b170-401a-bc74-ca721613e0da tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:31.728055 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e60ce1bd-b170-401a-bc74-ca721613e0da tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:31.875037 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-e60ce1bd-b170-401a-bc74-ca721613e0da tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7606b56fec4723b733f838ec34a17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceeabe5ea2a4a24b28901f50be5d532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:31.885429 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-e60ce1bd-b170-401a-bc74-ca721613e0da tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] 10.222.0.48 "GET /compute/v2.1/servers/2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985" status: 200 len: 1554 microversion: 2.1 time: 0.173528 Jul 21 10:47:31.886209 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 100/189] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:47:31 2022] GET /compute/v2.1/servers/2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985 => generated 1554 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:47:31.914176 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-a7a412ca-22a1-4bde-89c0-5fb79dd95dc0 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:47:31.916876 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-a7a412ca-22a1-4bde-89c0-5fb79dd95dc0 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: 86715109-fd38-41f4-b384-a319c310fc44] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:47:31.927652 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a7a412ca-22a1-4bde-89c0-5fb79dd95dc0 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:31.928539 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a7a412ca-22a1-4bde-89c0-5fb79dd95dc0 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:31.929903 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a7a412ca-22a1-4bde-89c0-5fb79dd95dc0 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:31.930814 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a7a412ca-22a1-4bde-89c0-5fb79dd95dc0 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:32.080489 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-a7a412ca-22a1-4bde-89c0-5fb79dd95dc0 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:32.088702 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-a7a412ca-22a1-4bde-89c0-5fb79dd95dc0 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44" status: 200 len: 1522 microversion: 2.1 time: 0.181818 Jul 21 10:47:32.089292 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 90/190] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:47:31 2022] GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44 => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:47:32.903369 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-3ea9d79e-dc1e-43ec-bc17-79c864cca8d9 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:47:32.903998 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-3ea9d79e-dc1e-43ec-bc17-79c864cca8d9 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] [instance: 2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:47:32.910477 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3ea9d79e-dc1e-43ec-bc17-79c864cca8d9 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:32.910950 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3ea9d79e-dc1e-43ec-bc17-79c864cca8d9 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:32.918945 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3ea9d79e-dc1e-43ec-bc17-79c864cca8d9 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:32.918945 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3ea9d79e-dc1e-43ec-bc17-79c864cca8d9 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:33.049696 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-3ea9d79e-dc1e-43ec-bc17-79c864cca8d9 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7606b56fec4723b733f838ec34a17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceeabe5ea2a4a24b28901f50be5d532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:33.059085 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-3ea9d79e-dc1e-43ec-bc17-79c864cca8d9 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] 10.222.0.48 "GET /compute/v2.1/servers/2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985" status: 200 len: 1554 microversion: 2.1 time: 0.160034 Jul 21 10:47:33.059759 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 101/191] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:47:32 2022] GET /compute/v2.1/servers/2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985 => generated 1554 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:47:33.107387 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-1124d442-9918-4f52-8644-db477f9dc743 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:47:33.107998 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-1124d442-9918-4f52-8644-db477f9dc743 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: 86715109-fd38-41f4-b384-a319c310fc44] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:47:33.114086 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1124d442-9918-4f52-8644-db477f9dc743 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:33.114723 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1124d442-9918-4f52-8644-db477f9dc743 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:33.115538 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1124d442-9918-4f52-8644-db477f9dc743 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:33.116189 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1124d442-9918-4f52-8644-db477f9dc743 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:33.281741 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-1124d442-9918-4f52-8644-db477f9dc743 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:33.293152 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-1124d442-9918-4f52-8644-db477f9dc743 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44" status: 200 len: 1522 microversion: 2.1 time: 0.189626 Jul 21 10:47:33.294285 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 91/192] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:47:33 2022] GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44 => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:47:34.077014 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-27171cb6-147b-4b90-a836-ace1dd62ca7a tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:47:34.077623 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-27171cb6-147b-4b90-a836-ace1dd62ca7a tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] [instance: 2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:47:34.087308 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-27171cb6-147b-4b90-a836-ace1dd62ca7a tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:34.088447 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-27171cb6-147b-4b90-a836-ace1dd62ca7a tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:34.089260 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-27171cb6-147b-4b90-a836-ace1dd62ca7a tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:34.089848 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-27171cb6-147b-4b90-a836-ace1dd62ca7a tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:34.278582 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-27171cb6-147b-4b90-a836-ace1dd62ca7a tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7606b56fec4723b733f838ec34a17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceeabe5ea2a4a24b28901f50be5d532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:34.299214 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-27171cb6-147b-4b90-a836-ace1dd62ca7a tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] 10.222.0.48 "GET /compute/v2.1/servers/2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985" status: 200 len: 1554 microversion: 2.1 time: 0.225507 Jul 21 10:47:34.299724 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 102/193] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:47:34 2022] GET /compute/v2.1/servers/2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985 => generated 1554 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:47:34.313768 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-24f22166-1d60-463d-bbed-9b8d239b3fdb tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:47:34.315339 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-24f22166-1d60-463d-bbed-9b8d239b3fdb tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: 86715109-fd38-41f4-b384-a319c310fc44] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:47:34.323592 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-24f22166-1d60-463d-bbed-9b8d239b3fdb tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:34.324044 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-24f22166-1d60-463d-bbed-9b8d239b3fdb tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:34.328588 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-24f22166-1d60-463d-bbed-9b8d239b3fdb tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:34.328588 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-24f22166-1d60-463d-bbed-9b8d239b3fdb tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:34.504519 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-24f22166-1d60-463d-bbed-9b8d239b3fdb tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:34.512839 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-24f22166-1d60-463d-bbed-9b8d239b3fdb tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44" status: 200 len: 1522 microversion: 2.1 time: 0.206499 Jul 21 10:47:34.513404 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 92/194] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:47:34 2022] GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44 => generated 1522 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:47:34.673484 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [req-bd20953d-d532-4917-a40e-bd372e5f9ac9 req-04be6cf5-711d-4470-8445-6fab2afd5a9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985", "name": "network-vif-deleted", "tag": "606e38eb-2f20-4811-87d6-bf2ef650eb71"}]} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:47:34.681570 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-bd20953d-d532-4917-a40e-bd372e5f9ac9 req-04be6cf5-711d-4470-8445-6fab2afd5a9a service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:34.682724 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-bd20953d-d532-4917-a40e-bd372e5f9ac9 req-04be6cf5-711d-4470-8445-6fab2afd5a9a service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:34.696520 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.compute.server_external_events [req-bd20953d-d532-4917-a40e-bd372e5f9ac9 req-04be6cf5-711d-4470-8445-6fab2afd5a9a service nova] Creating event network-vif-deleted:606e38eb-2f20-4811-87d6-bf2ef650eb71 for instance 2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985 on hv-cinder-84980 Jul 21 10:47:34.701794 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [req-bd20953d-d532-4917-a40e-bd372e5f9ac9 req-04be6cf5-711d-4470-8445-6fab2afd5a9a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031827 Jul 21 10:47:34.702410 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 103/195] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 21 10:47:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:47:35.317301 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-8f5ab523-08d7-4793-826a-c4657264a9bc tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:47:35.317852 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-8f5ab523-08d7-4793-826a-c4657264a9bc tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] [instance: 2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:47:35.326533 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8f5ab523-08d7-4793-826a-c4657264a9bc tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:35.328587 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8f5ab523-08d7-4793-826a-c4657264a9bc tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:35.330076 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8f5ab523-08d7-4793-826a-c4657264a9bc tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:35.330495 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8f5ab523-08d7-4793-826a-c4657264a9bc tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:35.405588 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-8f5ab523-08d7-4793-826a-c4657264a9bc tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7606b56fec4723b733f838ec34a17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceeabe5ea2a4a24b28901f50be5d532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:35.413668 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-8f5ab523-08d7-4793-826a-c4657264a9bc tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] 10.222.0.48 "GET /compute/v2.1/servers/2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985" status: 200 len: 1345 microversion: 2.1 time: 0.100253 Jul 21 10:47:35.414239 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 93/196] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:47:35 2022] GET /compute/v2.1/servers/2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985 => generated 1345 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:47:35.535795 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-8e71dd3a-b253-413f-b6b0-efeabc456cd1 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:47:35.536481 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-8e71dd3a-b253-413f-b6b0-efeabc456cd1 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: 86715109-fd38-41f4-b384-a319c310fc44] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:47:35.542869 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8e71dd3a-b253-413f-b6b0-efeabc456cd1 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:35.543322 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8e71dd3a-b253-413f-b6b0-efeabc456cd1 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:35.544234 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8e71dd3a-b253-413f-b6b0-efeabc456cd1 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:35.544665 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8e71dd3a-b253-413f-b6b0-efeabc456cd1 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:35.694968 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-8e71dd3a-b253-413f-b6b0-efeabc456cd1 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:35.704489 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-8e71dd3a-b253-413f-b6b0-efeabc456cd1 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44" status: 200 len: 1522 microversion: 2.1 time: 0.173217 Jul 21 10:47:35.705102 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 104/197] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:47:35 2022] GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:47:36.432076 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-412ca6d8-7e8c-4670-bd5f-7118230725f0 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:47:36.432625 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-412ca6d8-7e8c-4670-bd5f-7118230725f0 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] [instance: 2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:47:36.439433 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-412ca6d8-7e8c-4670-bd5f-7118230725f0 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:36.439888 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-412ca6d8-7e8c-4670-bd5f-7118230725f0 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:36.440654 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-412ca6d8-7e8c-4670-bd5f-7118230725f0 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:36.441084 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-412ca6d8-7e8c-4670-bd5f-7118230725f0 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:36.508034 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-412ca6d8-7e8c-4670-bd5f-7118230725f0 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7606b56fec4723b733f838ec34a17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceeabe5ea2a4a24b28901f50be5d532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:36.517519 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-412ca6d8-7e8c-4670-bd5f-7118230725f0 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] 10.222.0.48 "GET /compute/v2.1/servers/2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985" status: 200 len: 1345 microversion: 2.1 time: 0.089879 Jul 21 10:47:36.518106 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 94/198] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:47:36 2022] GET /compute/v2.1/servers/2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985 => generated 1345 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:47:36.727619 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-d9d09f78-b969-46d0-9421-86679cc616d1 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:47:36.728293 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-d9d09f78-b969-46d0-9421-86679cc616d1 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: 86715109-fd38-41f4-b384-a319c310fc44] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:47:36.735001 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d9d09f78-b969-46d0-9421-86679cc616d1 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:36.737427 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d9d09f78-b969-46d0-9421-86679cc616d1 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:36.737427 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d9d09f78-b969-46d0-9421-86679cc616d1 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:36.737427 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d9d09f78-b969-46d0-9421-86679cc616d1 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:36.889183 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-d9d09f78-b969-46d0-9421-86679cc616d1 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:36.896837 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-d9d09f78-b969-46d0-9421-86679cc616d1 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44" status: 200 len: 1522 microversion: 2.1 time: 0.173827 Jul 21 10:47:36.897904 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 105/199] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:47:36 2022] GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:47:37.535112 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-d4474467-9d46-40aa-848c-51dcdb2f37a9 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:47:37.535733 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-d4474467-9d46-40aa-848c-51dcdb2f37a9 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] [instance: 2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:47:37.542635 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d4474467-9d46-40aa-848c-51dcdb2f37a9 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:37.543036 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d4474467-9d46-40aa-848c-51dcdb2f37a9 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:37.543875 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d4474467-9d46-40aa-848c-51dcdb2f37a9 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:37.544544 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d4474467-9d46-40aa-848c-51dcdb2f37a9 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:37.612765 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-d4474467-9d46-40aa-848c-51dcdb2f37a9 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7606b56fec4723b733f838ec34a17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceeabe5ea2a4a24b28901f50be5d532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:37.621434 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-d4474467-9d46-40aa-848c-51dcdb2f37a9 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] 10.222.0.48 "GET /compute/v2.1/servers/2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985" status: 200 len: 1345 microversion: 2.1 time: 0.090394 Jul 21 10:47:37.622022 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 95/200] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:47:37 2022] GET /compute/v2.1/servers/2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985 => generated 1345 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:47:37.915609 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-2ae28277-4540-4bff-b9fb-d90b176f00db tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:47:37.916500 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-2ae28277-4540-4bff-b9fb-d90b176f00db tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: 86715109-fd38-41f4-b384-a319c310fc44] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:47:37.923459 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-2ae28277-4540-4bff-b9fb-d90b176f00db tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:37.923898 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-2ae28277-4540-4bff-b9fb-d90b176f00db tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:37.924651 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-2ae28277-4540-4bff-b9fb-d90b176f00db tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:37.925074 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-2ae28277-4540-4bff-b9fb-d90b176f00db tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:38.066179 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-2ae28277-4540-4bff-b9fb-d90b176f00db tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:38.077961 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-2ae28277-4540-4bff-b9fb-d90b176f00db tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44" status: 200 len: 1522 microversion: 2.1 time: 0.166386 Jul 21 10:47:38.079162 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 106/201] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:47:37 2022] GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:47:38.639991 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-1d8d5a1f-51de-4f1b-a2bb-eacaa6af7a99 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:47:38.640727 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-1d8d5a1f-51de-4f1b-a2bb-eacaa6af7a99 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] [instance: 2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:47:38.647069 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1d8d5a1f-51de-4f1b-a2bb-eacaa6af7a99 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:38.647508 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1d8d5a1f-51de-4f1b-a2bb-eacaa6af7a99 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:38.648354 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1d8d5a1f-51de-4f1b-a2bb-eacaa6af7a99 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:38.648794 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1d8d5a1f-51de-4f1b-a2bb-eacaa6af7a99 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:38.714710 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-1d8d5a1f-51de-4f1b-a2bb-eacaa6af7a99 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7606b56fec4723b733f838ec34a17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceeabe5ea2a4a24b28901f50be5d532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:38.723684 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-1d8d5a1f-51de-4f1b-a2bb-eacaa6af7a99 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] 10.222.0.48 "GET /compute/v2.1/servers/2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985" status: 200 len: 1345 microversion: 2.1 time: 0.088027 Jul 21 10:47:38.727979 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 96/202] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:47:38 2022] GET /compute/v2.1/servers/2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985 => generated 1345 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:47:39.099884 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-9267467e-0b0c-41de-ba3d-04f6d143db43 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:47:39.100879 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-9267467e-0b0c-41de-ba3d-04f6d143db43 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: 86715109-fd38-41f4-b384-a319c310fc44] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:47:39.109317 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9267467e-0b0c-41de-ba3d-04f6d143db43 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:39.109877 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9267467e-0b0c-41de-ba3d-04f6d143db43 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:39.111539 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9267467e-0b0c-41de-ba3d-04f6d143db43 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:39.112535 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9267467e-0b0c-41de-ba3d-04f6d143db43 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:39.254486 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-9267467e-0b0c-41de-ba3d-04f6d143db43 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:39.262970 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-9267467e-0b0c-41de-ba3d-04f6d143db43 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44" status: 200 len: 1522 microversion: 2.1 time: 0.167952 Jul 21 10:47:39.263551 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 107/203] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:47:39 2022] GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:47:39.745912 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-2704f14d-97d5-48f6-9523-b11ef18e6338 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:47:39.746534 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-2704f14d-97d5-48f6-9523-b11ef18e6338 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] [instance: 2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:47:39.753061 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2704f14d-97d5-48f6-9523-b11ef18e6338 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:39.753507 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2704f14d-97d5-48f6-9523-b11ef18e6338 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:39.754280 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2704f14d-97d5-48f6-9523-b11ef18e6338 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:39.754997 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2704f14d-97d5-48f6-9523-b11ef18e6338 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:39.788792 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2704f14d-97d5-48f6-9523-b11ef18e6338 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:39.789234 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2704f14d-97d5-48f6-9523-b11ef18e6338 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:39.790898 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.objects.instance [None req-2704f14d-97d5-48f6-9523-b11ef18e6338 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lazy-loading 'fault' on Instance uuid 2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985 {{(pid=124867) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 10:47:39.837920 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-2704f14d-97d5-48f6-9523-b11ef18e6338 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7606b56fec4723b733f838ec34a17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceeabe5ea2a4a24b28901f50be5d532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:39.847659 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-2704f14d-97d5-48f6-9523-b11ef18e6338 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] 10.222.0.48 "GET /compute/v2.1/servers/2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985" status: 200 len: 1350 microversion: 2.1 time: 0.106409 Jul 21 10:47:39.853489 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 97/204] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:47:39 2022] GET /compute/v2.1/servers/2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985 => generated 1350 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:47:40.280114 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-bab47f53-d5f7-4fe1-a005-1a54714b77c5 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:47:40.280762 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-bab47f53-d5f7-4fe1-a005-1a54714b77c5 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: 86715109-fd38-41f4-b384-a319c310fc44] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:47:40.287258 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-bab47f53-d5f7-4fe1-a005-1a54714b77c5 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:40.287846 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-bab47f53-d5f7-4fe1-a005-1a54714b77c5 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:40.288646 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-bab47f53-d5f7-4fe1-a005-1a54714b77c5 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:40.289084 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-bab47f53-d5f7-4fe1-a005-1a54714b77c5 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:40.427702 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-bab47f53-d5f7-4fe1-a005-1a54714b77c5 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:40.435823 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-bab47f53-d5f7-4fe1-a005-1a54714b77c5 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44" status: 200 len: 1522 microversion: 2.1 time: 0.159511 Jul 21 10:47:40.436398 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 108/205] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:47:40 2022] GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:47:40.865444 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-d10f31bc-035b-4ca6-b8f4-808a14c3c494 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:47:40.865962 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-d10f31bc-035b-4ca6-b8f4-808a14c3c494 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] [instance: 2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:47:40.874083 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d10f31bc-035b-4ca6-b8f4-808a14c3c494 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:40.874524 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d10f31bc-035b-4ca6-b8f4-808a14c3c494 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:40.875584 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d10f31bc-035b-4ca6-b8f4-808a14c3c494 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:40.876021 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d10f31bc-035b-4ca6-b8f4-808a14c3c494 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:40.891926 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.wsgi [None req-d10f31bc-035b-4ca6-b8f4-808a14c3c494 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] HTTP exception thrown: Instance 2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985 could not be found. Jul 21 10:47:40.896626 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-d10f31bc-035b-4ca6-b8f4-808a14c3c494 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Request method failure captured: Jul 21 10:47:40.896626 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: request: GET /compute/v2.1/servers/2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985 HTTP/1.1 Jul 21 10:47:40.896626 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Accept: application/json Jul 21 10:47:40.896626 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Accept-Encoding: identity Jul 21 10:47:40.896626 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Connection: close Jul 21 10:47:40.896626 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Content-Length: 0 Jul 21 10:47:40.896626 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Content-Type: application/json Jul 21 10:47:40.896626 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Host: 10.222.0.48 Jul 21 10:47:40.896626 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Openstack-System-Scope: None Jul 21 10:47:40.896626 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: User-Agent: python-urllib3/1.26.9 Jul 21 10:47:40.896626 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Auth-Token: gAAAAABi2S6C1PT5HhvN6AT43I1SUkmRSJ4SMwUCHobB1V47g4ElfIzrlziJSRT43eqsUAwqcAEze0c5PiIokPrWqxuGmms7MKVJApOJjR-49nGH36u_03HfsZjc9XcqXsKjmJjLz0_8DTNoBYnuWnm_xsZoAY3bfkGoAmCwdk0XPydVne5QMvM Jul 21 10:47:40.896626 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Domain-Id: None Jul 21 10:47:40.896626 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Domain-Name: None Jul 21 10:47:40.896626 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Identity-Status: Confirmed Jul 21 10:47:40.896626 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Is-Admin-Project: True Jul 21 10:47:40.896626 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Project-Domain-Id: default Jul 21 10:47:40.896626 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Project-Domain-Name: Default Jul 21 10:47:40.896626 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Project-Id: 9ceeabe5ea2a4a24b28901f50be5d532 Jul 21 10:47:40.896626 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Project-Name: tempest-DeleteServersTestJSON-1621201802 Jul 21 10:47:40.896626 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Role: reader,member Jul 21 10:47:40.896626 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Roles: reader,member Jul 21 10:47:40.897997 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9ceeabe5ea2a4a24b28901f50be5d532"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9ceeabe5ea2a4a24b28901f50be5d532"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9ceeabe5ea2a4a24b28901f50be5d532"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9ceeabe5ea2a4a24b28901f50be5d532"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] Jul 21 10:47:40.897997 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Tenant: tempest-DeleteServersTestJSON-1621201802 Jul 21 10:47:40.897997 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Tenant-Id: 9ceeabe5ea2a4a24b28901f50be5d532 Jul 21 10:47:40.897997 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Tenant-Name: tempest-DeleteServersTestJSON-1621201802 Jul 21 10:47:40.897997 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User: tempest-DeleteServersTestJSON-1621201802-project Jul 21 10:47:40.897997 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User-Domain-Id: default Jul 21 10:47:40.897997 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User-Domain-Name: Default Jul 21 10:47:40.897997 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User-Id: ad7606b56fec4723b733f838ec34a17e Jul 21 10:47:40.897997 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User-Name: tempest-DeleteServersTestJSON-1621201802-project Jul 21 10:47:40.897997 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: method: > Jul 21 10:47:40.897997 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: exception: Instance 2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985 could not be found. Jul 21 10:47:40.897997 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: action_args: {'id': '2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985'} Jul 21 10:47:40.899319 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 10:47:40.899319 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:47:40.899319 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 10:47:40.899319 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 10:47:40.899319 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 10:47:40.899319 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 10:47:40.899319 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 10:47:40.899319 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 10:47:40.899319 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 10:47:40.899319 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 10:47:40.899319 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985 could not be found. Jul 21 10:47:40.899319 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:47:40.899319 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:47:40.899319 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:47:40.899319 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:47:40.899319 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:47:40.899319 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:47:40.899319 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 10:47:40.899319 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 10:47:40.899319 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 10:47:40.901268 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 10:47:40.901268 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 10:47:40.901268 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 10:47:40.901268 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 10:47:40.901268 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 10:47:40.901268 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 10:47:40.901268 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 10:47:40.901268 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985 could not be found. Jul 21 10:47:40.901268 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:47:40.901268 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:47:40.901268 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:47:40.901268 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:47:40.901268 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:47:40.901268 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:47:40.901268 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 10:47:40.901268 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 10:47:40.901268 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985 could not be found. Jul 21 10:47:40.901268 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:47:40.903966 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-d10f31bc-035b-4ca6-b8f4-808a14c3c494 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Returning 404 to user: Instance 2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985 could not be found. {{(pid=124867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 10:47:40.903966 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-d10f31bc-035b-4ca6-b8f4-808a14c3c494 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] 10.222.0.48 "GET /compute/v2.1/servers/2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985" status: 404 len: 111 microversion: 2.1 time: 0.036561 Jul 21 10:47:40.903966 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 98/206] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:47:40 2022] GET /compute/v2.1/servers/2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 10:47:41.007311 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-cd020147-b360-454d-bcd5-8361d7e79f2a tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:47:41.008933 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-cd020147-b360-454d-bcd5-8361d7e79f2a tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] [instance: 2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:47:41.014949 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-cd020147-b360-454d-bcd5-8361d7e79f2a tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:41.015394 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-cd020147-b360-454d-bcd5-8361d7e79f2a tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:41.016142 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-cd020147-b360-454d-bcd5-8361d7e79f2a tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:41.016570 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-cd020147-b360-454d-bcd5-8361d7e79f2a tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:41.033766 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.wsgi [None req-cd020147-b360-454d-bcd5-8361d7e79f2a tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] HTTP exception thrown: Instance 2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985 could not be found. Jul 21 10:47:41.037618 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-cd020147-b360-454d-bcd5-8361d7e79f2a tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Request method failure captured: Jul 21 10:47:41.037618 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: request: GET /compute/v2.1/servers/2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985/os-volume_attachments HTTP/1.1 Jul 21 10:47:41.037618 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Accept: application/json Jul 21 10:47:41.037618 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Accept-Encoding: identity Jul 21 10:47:41.037618 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Connection: close Jul 21 10:47:41.037618 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Content-Length: 0 Jul 21 10:47:41.037618 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Content-Type: application/json Jul 21 10:47:41.037618 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Host: 10.222.0.48 Jul 21 10:47:41.037618 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Openstack-System-Scope: None Jul 21 10:47:41.037618 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: User-Agent: python-urllib3/1.26.9 Jul 21 10:47:41.037618 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Auth-Token: gAAAAABi2S6C1PT5HhvN6AT43I1SUkmRSJ4SMwUCHobB1V47g4ElfIzrlziJSRT43eqsUAwqcAEze0c5PiIokPrWqxuGmms7MKVJApOJjR-49nGH36u_03HfsZjc9XcqXsKjmJjLz0_8DTNoBYnuWnm_xsZoAY3bfkGoAmCwdk0XPydVne5QMvM Jul 21 10:47:41.037618 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Domain-Id: None Jul 21 10:47:41.037618 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Domain-Name: None Jul 21 10:47:41.037618 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Identity-Status: Confirmed Jul 21 10:47:41.037618 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Is-Admin-Project: True Jul 21 10:47:41.037618 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Domain-Id: default Jul 21 10:47:41.037618 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Domain-Name: Default Jul 21 10:47:41.037618 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Id: 9ceeabe5ea2a4a24b28901f50be5d532 Jul 21 10:47:41.037618 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Name: tempest-DeleteServersTestJSON-1621201802 Jul 21 10:47:41.037618 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Role: reader,member Jul 21 10:47:41.037618 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Roles: reader,member Jul 21 10:47:41.038857 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9ceeabe5ea2a4a24b28901f50be5d532"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9ceeabe5ea2a4a24b28901f50be5d532"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9ceeabe5ea2a4a24b28901f50be5d532"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9ceeabe5ea2a4a24b28901f50be5d532"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] Jul 21 10:47:41.038857 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Tenant: tempest-DeleteServersTestJSON-1621201802 Jul 21 10:47:41.038857 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Tenant-Id: 9ceeabe5ea2a4a24b28901f50be5d532 Jul 21 10:47:41.038857 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Tenant-Name: tempest-DeleteServersTestJSON-1621201802 Jul 21 10:47:41.038857 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User: tempest-DeleteServersTestJSON-1621201802-project Jul 21 10:47:41.038857 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Domain-Id: default Jul 21 10:47:41.038857 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Domain-Name: Default Jul 21 10:47:41.038857 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Id: ad7606b56fec4723b733f838ec34a17e Jul 21 10:47:41.038857 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Name: tempest-DeleteServersTestJSON-1621201802-project Jul 21 10:47:41.038857 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: method: > Jul 21 10:47:41.038857 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: exception: Instance 2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985 could not be found. Jul 21 10:47:41.038857 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: action_args: {'server_id': '2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985'} Jul 21 10:47:41.039617 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 10:47:41.039617 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:47:41.039617 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 10:47:41.039617 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 10:47:41.039617 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 10:47:41.039617 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 10:47:41.039617 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 10:47:41.039617 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 10:47:41.039617 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 10:47:41.039617 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 10:47:41.039617 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985 could not be found. Jul 21 10:47:41.039617 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:47:41.039617 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:47:41.039617 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:47:41.039617 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:47:41.039617 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:47:41.039617 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:47:41.039617 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 10:47:41.039617 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 10:47:41.039617 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 10:47:41.041344 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 10:47:41.041344 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 21 10:47:41.041344 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 10:47:41.041344 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 21 10:47:41.041344 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 10:47:41.041344 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 21 10:47:41.041344 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 21 10:47:41.041344 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 10:47:41.041344 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 10:47:41.041344 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985 could not be found. Jul 21 10:47:41.041344 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:47:41.041344 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:47:41.041344 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:47:41.041344 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:47:41.041344 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:47:41.041344 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:47:41.041344 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 10:47:41.041344 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 10:47:41.041344 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985 could not be found. Jul 21 10:47:41.041344 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:47:41.042389 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-cd020147-b360-454d-bcd5-8361d7e79f2a tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Returning 404 to user: Instance 2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985 could not be found. {{(pid=124868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 10:47:41.042389 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-cd020147-b360-454d-bcd5-8361d7e79f2a tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] 10.222.0.48 "GET /compute/v2.1/servers/2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.035845 Jul 21 10:47:41.042389 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 109/207] 10.222.0.48 () {58 vars in 1301 bytes} [Thu Jul 21 10:47:41 2022] GET /compute/v2.1/servers/2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985/os-volume_attachments => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 10:47:41.452995 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-8f5cf77b-a47d-4941-97f4-bc5df315746e tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:47:41.453604 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-8f5cf77b-a47d-4941-97f4-bc5df315746e tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: 86715109-fd38-41f4-b384-a319c310fc44] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:47:41.459690 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8f5cf77b-a47d-4941-97f4-bc5df315746e tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:41.460137 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8f5cf77b-a47d-4941-97f4-bc5df315746e tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:41.460900 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8f5cf77b-a47d-4941-97f4-bc5df315746e tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:41.461928 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8f5cf77b-a47d-4941-97f4-bc5df315746e tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:41.599012 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-8f5cf77b-a47d-4941-97f4-bc5df315746e tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:41.607274 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-8f5cf77b-a47d-4941-97f4-bc5df315746e tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44" status: 200 len: 1522 microversion: 2.1 time: 0.158309 Jul 21 10:47:41.608399 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 99/208] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:47:41 2022] GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:47:42.411720 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-512d2c55-ced5-4b8e-b451-05d6c596cdcc tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:47:42.412275 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-512d2c55-ced5-4b8e-b451-05d6c596cdcc tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] [instance: 2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:47:42.420689 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-512d2c55-ced5-4b8e-b451-05d6c596cdcc tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:42.421262 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-512d2c55-ced5-4b8e-b451-05d6c596cdcc tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:42.422137 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-512d2c55-ced5-4b8e-b451-05d6c596cdcc tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:42.422661 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-512d2c55-ced5-4b8e-b451-05d6c596cdcc tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:42.438679 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.wsgi [None req-512d2c55-ced5-4b8e-b451-05d6c596cdcc tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] HTTP exception thrown: Instance 2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985 could not be found. Jul 21 10:47:42.441077 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-512d2c55-ced5-4b8e-b451-05d6c596cdcc tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Request method failure captured: Jul 21 10:47:42.441077 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: request: DELETE /compute/v2.1/servers/2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985 HTTP/1.1 Jul 21 10:47:42.441077 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Accept: application/json Jul 21 10:47:42.441077 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Accept-Encoding: identity Jul 21 10:47:42.441077 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Connection: close Jul 21 10:47:42.441077 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Content-Length: 0 Jul 21 10:47:42.441077 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Content-Type: application/json Jul 21 10:47:42.441077 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Host: 10.222.0.48 Jul 21 10:47:42.441077 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Openstack-System-Scope: None Jul 21 10:47:42.441077 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: User-Agent: python-urllib3/1.26.9 Jul 21 10:47:42.441077 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Auth-Token: gAAAAABi2S6C1PT5HhvN6AT43I1SUkmRSJ4SMwUCHobB1V47g4ElfIzrlziJSRT43eqsUAwqcAEze0c5PiIokPrWqxuGmms7MKVJApOJjR-49nGH36u_03HfsZjc9XcqXsKjmJjLz0_8DTNoBYnuWnm_xsZoAY3bfkGoAmCwdk0XPydVne5QMvM Jul 21 10:47:42.441077 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Domain-Id: None Jul 21 10:47:42.441077 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Domain-Name: None Jul 21 10:47:42.441077 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Identity-Status: Confirmed Jul 21 10:47:42.441077 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Is-Admin-Project: True Jul 21 10:47:42.441077 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Domain-Id: default Jul 21 10:47:42.441077 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Domain-Name: Default Jul 21 10:47:42.441077 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Id: 9ceeabe5ea2a4a24b28901f50be5d532 Jul 21 10:47:42.441077 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Name: tempest-DeleteServersTestJSON-1621201802 Jul 21 10:47:42.441077 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Role: reader,member Jul 21 10:47:42.441077 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Roles: reader,member Jul 21 10:47:42.442452 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9ceeabe5ea2a4a24b28901f50be5d532"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9ceeabe5ea2a4a24b28901f50be5d532"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9ceeabe5ea2a4a24b28901f50be5d532"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9ceeabe5ea2a4a24b28901f50be5d532"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] Jul 21 10:47:42.442452 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Tenant: tempest-DeleteServersTestJSON-1621201802 Jul 21 10:47:42.442452 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Tenant-Id: 9ceeabe5ea2a4a24b28901f50be5d532 Jul 21 10:47:42.442452 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Tenant-Name: tempest-DeleteServersTestJSON-1621201802 Jul 21 10:47:42.442452 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User: tempest-DeleteServersTestJSON-1621201802-project Jul 21 10:47:42.442452 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Domain-Id: default Jul 21 10:47:42.442452 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Domain-Name: Default Jul 21 10:47:42.442452 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Id: ad7606b56fec4723b733f838ec34a17e Jul 21 10:47:42.442452 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Name: tempest-DeleteServersTestJSON-1621201802-project Jul 21 10:47:42.442452 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: method: > Jul 21 10:47:42.442452 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: exception: Instance 2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985 could not be found. Jul 21 10:47:42.442452 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: action_args: {'id': '2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985'} Jul 21 10:47:42.443134 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 10:47:42.443134 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:47:42.443134 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 10:47:42.443134 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 10:47:42.443134 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 10:47:42.443134 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 10:47:42.443134 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 10:47:42.443134 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 10:47:42.443134 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 10:47:42.443134 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 10:47:42.443134 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985 could not be found. Jul 21 10:47:42.443134 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:47:42.443134 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:47:42.443134 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:47:42.443134 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:47:42.443134 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:47:42.443134 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:47:42.443134 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 10:47:42.443134 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 10:47:42.443134 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 10:47:42.444132 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 10:47:42.444132 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 21 10:47:42.444132 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 21 10:47:42.444132 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 21 10:47:42.444132 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 21 10:47:42.444132 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 10:47:42.444132 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 10:47:42.444132 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 10:47:42.444132 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 10:47:42.444132 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985 could not be found. Jul 21 10:47:42.444132 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:47:42.444132 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:47:42.444132 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:47:42.444132 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:47:42.444132 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:47:42.444132 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:47:42.444132 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 10:47:42.444132 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 10:47:42.444132 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985 could not be found. Jul 21 10:47:42.444132 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:47:42.445149 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-512d2c55-ced5-4b8e-b451-05d6c596cdcc tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Returning 404 to user: Instance 2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985 could not be found. {{(pid=124868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 10:47:42.445149 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-512d2c55-ced5-4b8e-b451-05d6c596cdcc tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] 10.222.0.48 "DELETE /compute/v2.1/servers/2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985" status: 404 len: 111 microversion: 2.1 time: 0.034846 Jul 21 10:47:42.445149 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 110/209] 10.222.0.48 () {58 vars in 1238 bytes} [Thu Jul 21 10:47:42 2022] DELETE /compute/v2.1/servers/2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 10:47:42.452736 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-9812c11c-2998-4ebc-b993-0dff1a78b374 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:47:42.453345 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-9812c11c-2998-4ebc-b993-0dff1a78b374 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] [instance: 2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:47:42.459723 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9812c11c-2998-4ebc-b993-0dff1a78b374 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:42.460170 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9812c11c-2998-4ebc-b993-0dff1a78b374 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:42.464559 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9812c11c-2998-4ebc-b993-0dff1a78b374 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:42.464559 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9812c11c-2998-4ebc-b993-0dff1a78b374 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:42.478148 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.wsgi [None req-9812c11c-2998-4ebc-b993-0dff1a78b374 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] HTTP exception thrown: Instance 2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985 could not be found. Jul 21 10:47:42.480058 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-9812c11c-2998-4ebc-b993-0dff1a78b374 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Request method failure captured: Jul 21 10:47:42.480058 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: request: GET /compute/v2.1/servers/2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985 HTTP/1.1 Jul 21 10:47:42.480058 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Accept: application/json Jul 21 10:47:42.480058 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Accept-Encoding: identity Jul 21 10:47:42.480058 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Connection: close Jul 21 10:47:42.480058 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Content-Length: 0 Jul 21 10:47:42.480058 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Content-Type: application/json Jul 21 10:47:42.480058 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Host: 10.222.0.48 Jul 21 10:47:42.480058 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Openstack-System-Scope: None Jul 21 10:47:42.480058 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: User-Agent: python-urllib3/1.26.9 Jul 21 10:47:42.480058 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Auth-Token: gAAAAABi2S6C1PT5HhvN6AT43I1SUkmRSJ4SMwUCHobB1V47g4ElfIzrlziJSRT43eqsUAwqcAEze0c5PiIokPrWqxuGmms7MKVJApOJjR-49nGH36u_03HfsZjc9XcqXsKjmJjLz0_8DTNoBYnuWnm_xsZoAY3bfkGoAmCwdk0XPydVne5QMvM Jul 21 10:47:42.480058 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Domain-Id: None Jul 21 10:47:42.480058 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Domain-Name: None Jul 21 10:47:42.480058 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Identity-Status: Confirmed Jul 21 10:47:42.480058 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Is-Admin-Project: True Jul 21 10:47:42.480058 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Project-Domain-Id: default Jul 21 10:47:42.480058 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Project-Domain-Name: Default Jul 21 10:47:42.480058 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Project-Id: 9ceeabe5ea2a4a24b28901f50be5d532 Jul 21 10:47:42.480058 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Project-Name: tempest-DeleteServersTestJSON-1621201802 Jul 21 10:47:42.480058 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Role: reader,member Jul 21 10:47:42.480058 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Roles: reader,member Jul 21 10:47:42.481511 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9ceeabe5ea2a4a24b28901f50be5d532"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9ceeabe5ea2a4a24b28901f50be5d532"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9ceeabe5ea2a4a24b28901f50be5d532"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9ceeabe5ea2a4a24b28901f50be5d532"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] Jul 21 10:47:42.481511 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Tenant: tempest-DeleteServersTestJSON-1621201802 Jul 21 10:47:42.481511 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Tenant-Id: 9ceeabe5ea2a4a24b28901f50be5d532 Jul 21 10:47:42.481511 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Tenant-Name: tempest-DeleteServersTestJSON-1621201802 Jul 21 10:47:42.481511 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User: tempest-DeleteServersTestJSON-1621201802-project Jul 21 10:47:42.481511 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User-Domain-Id: default Jul 21 10:47:42.481511 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User-Domain-Name: Default Jul 21 10:47:42.481511 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User-Id: ad7606b56fec4723b733f838ec34a17e Jul 21 10:47:42.481511 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User-Name: tempest-DeleteServersTestJSON-1621201802-project Jul 21 10:47:42.481511 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: method: > Jul 21 10:47:42.481511 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: exception: Instance 2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985 could not be found. Jul 21 10:47:42.481511 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: action_args: {'id': '2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985'} Jul 21 10:47:42.482269 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 10:47:42.482269 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:47:42.482269 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 10:47:42.482269 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 10:47:42.482269 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 10:47:42.482269 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 10:47:42.482269 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 10:47:42.482269 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 10:47:42.482269 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 10:47:42.482269 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 10:47:42.482269 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985 could not be found. Jul 21 10:47:42.482269 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:47:42.482269 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:47:42.482269 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:47:42.482269 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:47:42.482269 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:47:42.482269 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:47:42.482269 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 10:47:42.482269 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 10:47:42.482269 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 10:47:42.483434 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 10:47:42.483434 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 10:47:42.483434 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 10:47:42.483434 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 10:47:42.483434 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 10:47:42.483434 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 10:47:42.483434 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 10:47:42.483434 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985 could not be found. Jul 21 10:47:42.483434 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:47:42.483434 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:47:42.483434 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:47:42.483434 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:47:42.483434 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:47:42.483434 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:47:42.483434 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 10:47:42.483434 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 10:47:42.483434 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985 could not be found. Jul 21 10:47:42.483434 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:47:42.484378 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-9812c11c-2998-4ebc-b993-0dff1a78b374 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] Returning 404 to user: Instance 2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985 could not be found. {{(pid=124867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 10:47:42.484378 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-9812c11c-2998-4ebc-b993-0dff1a78b374 tempest-DeleteServersTestJSON-1621201802 tempest-DeleteServersTestJSON-1621201802-project] 10.222.0.48 "GET /compute/v2.1/servers/2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985" status: 404 len: 111 microversion: 2.1 time: 0.032793 Jul 21 10:47:42.484378 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 100/210] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:47:42 2022] GET /compute/v2.1/servers/2b5cde52-f3b3-4e40-a5dc-d2f24cbdc985 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 10:47:42.625439 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-23427887-972e-4073-b897-8066550459e5 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:47:42.626097 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-23427887-972e-4073-b897-8066550459e5 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: 86715109-fd38-41f4-b384-a319c310fc44] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:47:42.632456 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-23427887-972e-4073-b897-8066550459e5 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:42.633002 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-23427887-972e-4073-b897-8066550459e5 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:42.633778 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-23427887-972e-4073-b897-8066550459e5 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:42.634267 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-23427887-972e-4073-b897-8066550459e5 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:42.900106 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-23427887-972e-4073-b897-8066550459e5 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:42.908522 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-23427887-972e-4073-b897-8066550459e5 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44" status: 200 len: 1522 microversion: 2.1 time: 0.286876 Jul 21 10:47:42.909335 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 111/211] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:47:42 2022] GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44 => generated 1522 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:47:43.926355 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-ecc5a04e-5c8d-4175-b15e-7e9471cff268 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:47:43.928660 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-ecc5a04e-5c8d-4175-b15e-7e9471cff268 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: 86715109-fd38-41f4-b384-a319c310fc44] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:47:43.939821 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ecc5a04e-5c8d-4175-b15e-7e9471cff268 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:43.940653 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ecc5a04e-5c8d-4175-b15e-7e9471cff268 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:43.942299 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ecc5a04e-5c8d-4175-b15e-7e9471cff268 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:43.943197 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ecc5a04e-5c8d-4175-b15e-7e9471cff268 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:43.978528 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:47:44.179894 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-ecc5a04e-5c8d-4175-b15e-7e9471cff268 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:44.189125 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-ecc5a04e-5c8d-4175-b15e-7e9471cff268 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44" status: 200 len: 1522 microversion: 2.1 time: 0.267122 Jul 21 10:47:44.190106 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 101/212] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:47:43 2022] GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44 => generated 1522 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:47:45.210086 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-a223ece8-e797-4b6a-a058-dd9f8a9afb70 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:47:45.210885 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-a223ece8-e797-4b6a-a058-dd9f8a9afb70 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: 86715109-fd38-41f4-b384-a319c310fc44] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:47:45.222098 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a223ece8-e797-4b6a-a058-dd9f8a9afb70 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:45.222940 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a223ece8-e797-4b6a-a058-dd9f8a9afb70 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:45.225857 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a223ece8-e797-4b6a-a058-dd9f8a9afb70 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:45.226493 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a223ece8-e797-4b6a-a058-dd9f8a9afb70 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:45.289624 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell1:SELECT=100 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:47:45.535436 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-a223ece8-e797-4b6a-a058-dd9f8a9afb70 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:45.559360 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-a223ece8-e797-4b6a-a058-dd9f8a9afb70 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44" status: 200 len: 1522 microversion: 2.1 time: 0.354543 Jul 21 10:47:45.560005 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 112/213] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:47:45 2022] GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44 => generated 1522 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:47:46.579206 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-762335ec-f189-4258-94b7-41ef92eb9e40 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:47:46.579972 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-762335ec-f189-4258-94b7-41ef92eb9e40 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: 86715109-fd38-41f4-b384-a319c310fc44] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:47:46.587996 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-762335ec-f189-4258-94b7-41ef92eb9e40 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:46.589053 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-762335ec-f189-4258-94b7-41ef92eb9e40 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:46.589906 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-762335ec-f189-4258-94b7-41ef92eb9e40 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:46.590344 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-762335ec-f189-4258-94b7-41ef92eb9e40 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:46.780148 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-762335ec-f189-4258-94b7-41ef92eb9e40 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:46.795297 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-762335ec-f189-4258-94b7-41ef92eb9e40 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44" status: 200 len: 1522 microversion: 2.1 time: 0.218106 Jul 21 10:47:46.796824 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 102/214] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:47:46 2022] GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44 => generated 1522 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:47:47.812936 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-9534cc91-7c35-487c-8c22-a6764f52fbf5 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:47:47.813694 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-9534cc91-7c35-487c-8c22-a6764f52fbf5 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: 86715109-fd38-41f4-b384-a319c310fc44] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:47:47.819741 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9534cc91-7c35-487c-8c22-a6764f52fbf5 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:47.820189 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9534cc91-7c35-487c-8c22-a6764f52fbf5 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:47.820962 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9534cc91-7c35-487c-8c22-a6764f52fbf5 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:47.821397 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9534cc91-7c35-487c-8c22-a6764f52fbf5 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:47.956655 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-9534cc91-7c35-487c-8c22-a6764f52fbf5 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:47.964771 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-9534cc91-7c35-487c-8c22-a6764f52fbf5 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44" status: 200 len: 1522 microversion: 2.1 time: 0.155837 Jul 21 10:47:47.965340 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 113/215] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:47:47 2022] GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:47:48.983201 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-3390c756-541a-4d07-bad2-7ce657b63f37 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:47:48.983772 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-3390c756-541a-4d07-bad2-7ce657b63f37 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: 86715109-fd38-41f4-b384-a319c310fc44] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:47:48.989751 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3390c756-541a-4d07-bad2-7ce657b63f37 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:48.990189 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3390c756-541a-4d07-bad2-7ce657b63f37 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:48.990965 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3390c756-541a-4d07-bad2-7ce657b63f37 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:48.991393 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3390c756-541a-4d07-bad2-7ce657b63f37 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:49.134973 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-3390c756-541a-4d07-bad2-7ce657b63f37 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:49.143454 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-3390c756-541a-4d07-bad2-7ce657b63f37 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44" status: 200 len: 1522 microversion: 2.1 time: 0.163855 Jul 21 10:47:49.144199 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 103/216] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:47:48 2022] GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:47:49.418575 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-ad1ea064-f60d-4a3c-9d25-bb722e646a25 tempest-VolumesGetTestJSON-867501968 tempest-VolumesGetTestJSON-867501968-project] Action: 'create', calling method: .version_select at 0x7f79634ce700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-836305586", "metadata": {"Type": "work"}}} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:47:50.047423 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-ad1ea064-f60d-4a3c-9d25-bb722e646a25 tempest-VolumesGetTestJSON-867501968 tempest-VolumesGetTestJSON-867501968-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.746083 Jul 21 10:47:50.048152 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 114/217] 10.222.0.48 () {60 vars in 1155 bytes} [Thu Jul 21 10:47:49 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 748 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 21 10:47:50.060250 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-ac623319-e49f-49a3-bed7-8508d0cf3d33 tempest-VolumesGetTestJSON-867501968 tempest-VolumesGetTestJSON-867501968-project] Calling method '.version_select at 0x7f795ece23a0>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:47:50.111916 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-ac623319-e49f-49a3-bed7-8508d0cf3d33 tempest-VolumesGetTestJSON-867501968 tempest-VolumesGetTestJSON-867501968-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/a216c772-a5f6-49e1-8496-8c71e53a1e8f" status: 200 len: 352 microversion: 2.1 time: 0.054037 Jul 21 10:47:50.111916 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 104/218] 10.222.0.48 () {58 vars in 1244 bytes} [Thu Jul 21 10:47:50 2022] GET /compute/v2.1/os-volumes/a216c772-a5f6-49e1-8496-8c71e53a1e8f => generated 352 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:47:50.160724 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-4b594fb9-7daa-4f52-bad4-cab8465f79a9 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:47:50.161250 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-4b594fb9-7daa-4f52-bad4-cab8465f79a9 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: 86715109-fd38-41f4-b384-a319c310fc44] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:47:50.168185 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4b594fb9-7daa-4f52-bad4-cab8465f79a9 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:50.168632 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4b594fb9-7daa-4f52-bad4-cab8465f79a9 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:50.169383 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4b594fb9-7daa-4f52-bad4-cab8465f79a9 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:50.169810 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4b594fb9-7daa-4f52-bad4-cab8465f79a9 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:50.303801 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-4b594fb9-7daa-4f52-bad4-cab8465f79a9 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:50.311678 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-4b594fb9-7daa-4f52-bad4-cab8465f79a9 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44" status: 200 len: 1522 microversion: 2.1 time: 0.154863 Jul 21 10:47:50.312246 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 115/219] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:47:50 2022] GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:47:51.123128 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-f5cf1c85-592e-43d0-893f-48469b587ac0 tempest-VolumesGetTestJSON-867501968 tempest-VolumesGetTestJSON-867501968-project] Calling method '.version_select at 0x7f795ece2a60>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:47:51.186283 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-f5cf1c85-592e-43d0-893f-48469b587ac0 tempest-VolumesGetTestJSON-867501968 tempest-VolumesGetTestJSON-867501968-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/a216c772-a5f6-49e1-8496-8c71e53a1e8f" status: 200 len: 352 microversion: 2.1 time: 0.066977 Jul 21 10:47:51.187060 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 105/220] 10.222.0.48 () {58 vars in 1244 bytes} [Thu Jul 21 10:47:51 2022] GET /compute/v2.1/os-volumes/a216c772-a5f6-49e1-8496-8c71e53a1e8f => generated 352 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:47:51.331529 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-0a7a2c43-e6d4-4b1f-88f2-2ceab7df87c0 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:47:51.332251 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-0a7a2c43-e6d4-4b1f-88f2-2ceab7df87c0 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: 86715109-fd38-41f4-b384-a319c310fc44] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:47:51.340248 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0a7a2c43-e6d4-4b1f-88f2-2ceab7df87c0 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:51.341151 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0a7a2c43-e6d4-4b1f-88f2-2ceab7df87c0 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:51.342074 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0a7a2c43-e6d4-4b1f-88f2-2ceab7df87c0 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:51.342899 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0a7a2c43-e6d4-4b1f-88f2-2ceab7df87c0 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:51.506009 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-0a7a2c43-e6d4-4b1f-88f2-2ceab7df87c0 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:51.514952 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-0a7a2c43-e6d4-4b1f-88f2-2ceab7df87c0 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44" status: 200 len: 1522 microversion: 2.1 time: 0.188700 Jul 21 10:47:51.518685 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 116/221] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:47:51 2022] GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44 => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:47:52.200885 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-3df79e4c-de01-4d43-b0df-f297a3669f44 tempest-VolumesGetTestJSON-867501968 tempest-VolumesGetTestJSON-867501968-project] Calling method '.version_select at 0x7f795ec25820>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:47:52.262720 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-3df79e4c-de01-4d43-b0df-f297a3669f44 tempest-VolumesGetTestJSON-867501968 tempest-VolumesGetTestJSON-867501968-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/a216c772-a5f6-49e1-8496-8c71e53a1e8f" status: 200 len: 353 microversion: 2.1 time: 0.066692 Jul 21 10:47:52.269524 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 106/222] 10.222.0.48 () {58 vars in 1244 bytes} [Thu Jul 21 10:47:52 2022] GET /compute/v2.1/os-volumes/a216c772-a5f6-49e1-8496-8c71e53a1e8f => generated 353 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:47:52.275108 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-55f51257-0ed0-494f-bf42-a3746ebd872a tempest-VolumesGetTestJSON-867501968 tempest-VolumesGetTestJSON-867501968-project] Calling method '.version_select at 0x7f79634d7f70>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:47:52.336843 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-55f51257-0ed0-494f-bf42-a3746ebd872a tempest-VolumesGetTestJSON-867501968 tempest-VolumesGetTestJSON-867501968-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/a216c772-a5f6-49e1-8496-8c71e53a1e8f" status: 200 len: 353 microversion: 2.1 time: 0.066312 Jul 21 10:47:52.339236 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 117/223] 10.222.0.48 () {58 vars in 1244 bytes} [Thu Jul 21 10:47:52 2022] GET /compute/v2.1/os-volumes/a216c772-a5f6-49e1-8496-8c71e53a1e8f => generated 353 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 10:47:52.360202 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-cd3b6464-6464-45a4-a2a5-1ee091695577 tempest-VolumesGetTestJSON-867501968 tempest-VolumesGetTestJSON-867501968-project] Calling method '.version_select at 0x7f795ebc1c10>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:47:52.534901 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-7d90f359-68e5-4387-85f3-2a291317752e tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:47:52.535515 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-7d90f359-68e5-4387-85f3-2a291317752e tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: 86715109-fd38-41f4-b384-a319c310fc44] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:47:52.542234 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7d90f359-68e5-4387-85f3-2a291317752e tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:52.542711 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7d90f359-68e5-4387-85f3-2a291317752e tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:52.543483 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7d90f359-68e5-4387-85f3-2a291317752e tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:52.543916 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7d90f359-68e5-4387-85f3-2a291317752e tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:52.592548 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-cd3b6464-6464-45a4-a2a5-1ee091695577 tempest-VolumesGetTestJSON-867501968 tempest-VolumesGetTestJSON-867501968-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/a216c772-a5f6-49e1-8496-8c71e53a1e8f" status: 202 len: 0 microversion: 2.1 time: 0.241842 Jul 21 10:47:52.593112 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 107/224] 10.222.0.48 () {58 vars in 1247 bytes} [Thu Jul 21 10:47:52 2022] DELETE /compute/v2.1/os-volumes/a216c772-a5f6-49e1-8496-8c71e53a1e8f => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 10:47:52.601653 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-404de025-8fc0-4c21-af7b-502a7783bbea tempest-VolumesGetTestJSON-867501968 tempest-VolumesGetTestJSON-867501968-project] Calling method '.version_select at 0x7f795ec258b0>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:47:52.663800 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-404de025-8fc0-4c21-af7b-502a7783bbea tempest-VolumesGetTestJSON-867501968 tempest-VolumesGetTestJSON-867501968-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/a216c772-a5f6-49e1-8496-8c71e53a1e8f" status: 200 len: 352 microversion: 2.1 time: 0.066023 Jul 21 10:47:52.669057 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 108/225] 10.222.0.48 () {58 vars in 1244 bytes} [Thu Jul 21 10:47:52 2022] GET /compute/v2.1/os-volumes/a216c772-a5f6-49e1-8496-8c71e53a1e8f => generated 352 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 10:47:52.702517 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-7d90f359-68e5-4387-85f3-2a291317752e tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:52.710997 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-7d90f359-68e5-4387-85f3-2a291317752e tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44" status: 200 len: 1522 microversion: 2.1 time: 0.180128 Jul 21 10:47:52.712183 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 118/226] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:47:52 2022] GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44 => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:47:53.677553 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-d70d1ade-d065-4b39-9e4d-a5cde8dc7412 tempest-VolumesGetTestJSON-867501968 tempest-VolumesGetTestJSON-867501968-project] Calling method '.version_select at 0x7f795ece2af0>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:47:53.717323 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.wsgi [None req-d70d1ade-d065-4b39-9e4d-a5cde8dc7412 tempest-VolumesGetTestJSON-867501968 tempest-VolumesGetTestJSON-867501968-project] HTTP exception thrown: Volume a216c772-a5f6-49e1-8496-8c71e53a1e8f could not be found. Jul 21 10:47:53.719308 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-d70d1ade-d065-4b39-9e4d-a5cde8dc7412 tempest-VolumesGetTestJSON-867501968 tempest-VolumesGetTestJSON-867501968-project] Request method failure captured: Jul 21 10:47:53.719308 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: request: GET /compute/v2.1/os-volumes/a216c772-a5f6-49e1-8496-8c71e53a1e8f HTTP/1.1 Jul 21 10:47:53.719308 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Accept: application/json Jul 21 10:47:53.719308 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Accept-Encoding: identity Jul 21 10:47:53.719308 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Connection: close Jul 21 10:47:53.719308 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Content-Length: 0 Jul 21 10:47:53.719308 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Content-Type: application/json Jul 21 10:47:53.719308 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Host: 10.222.0.48 Jul 21 10:47:53.719308 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Openstack-System-Scope: None Jul 21 10:47:53.719308 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: User-Agent: python-urllib3/1.26.9 Jul 21 10:47:53.719308 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Auth-Token: gAAAAABi2S7VV7wwUa9ILsxSWBmMW5UqGwtxD_EucATehvDZBpAhenWFW3zJ87KBmW2qppG8RSMBGE1XahQWNWuEwesSUORqF4Txd-zaAHU1jlUJFEpxVCnf3fKOqYWwMM0_yH-e5IVM_sGbtAGGL1aRq4fy0v2lFQhHuy4UBNa5NkzThgs685c Jul 21 10:47:53.719308 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Domain-Id: None Jul 21 10:47:53.719308 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Domain-Name: None Jul 21 10:47:53.719308 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Identity-Status: Confirmed Jul 21 10:47:53.719308 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Is-Admin-Project: True Jul 21 10:47:53.719308 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Project-Domain-Id: default Jul 21 10:47:53.719308 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Project-Domain-Name: Default Jul 21 10:47:53.719308 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Project-Id: ed76edca283846f58c6e34e6fbc7599a Jul 21 10:47:53.719308 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Project-Name: tempest-VolumesGetTestJSON-867501968 Jul 21 10:47:53.719308 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Role: reader,member Jul 21 10:47:53.719308 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Roles: reader,member Jul 21 10:47:53.720895 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ed76edca283846f58c6e34e6fbc7599a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ed76edca283846f58c6e34e6fbc7599a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ed76edca283846f58c6e34e6fbc7599a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ed76edca283846f58c6e34e6fbc7599a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] Jul 21 10:47:53.720895 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Tenant: tempest-VolumesGetTestJSON-867501968 Jul 21 10:47:53.720895 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Tenant-Id: ed76edca283846f58c6e34e6fbc7599a Jul 21 10:47:53.720895 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Tenant-Name: tempest-VolumesGetTestJSON-867501968 Jul 21 10:47:53.720895 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User: tempest-VolumesGetTestJSON-867501968-project Jul 21 10:47:53.720895 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User-Domain-Id: default Jul 21 10:47:53.720895 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User-Domain-Name: Default Jul 21 10:47:53.720895 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User-Id: 3cd254f06b234870a6559ac25034ec26 Jul 21 10:47:53.720895 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User-Name: tempest-VolumesGetTestJSON-867501968-project Jul 21 10:47:53.720895 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: method: Jul 21 10:47:53.720895 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: exception: Volume a216c772-a5f6-49e1-8496-8c71e53a1e8f could not be found. Jul 21 10:47:53.720895 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: action_args: {'id': 'a216c772-a5f6-49e1-8496-8c71e53a1e8f'} Jul 21 10:47:53.720895 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 10:47:53.721804 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:47:53.721804 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 10:47:53.721804 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 10:47:53.721804 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 21 10:47:53.721804 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 21 10:47:53.721804 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 21 10:47:53.721804 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 21 10:47:53.721804 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 10:47:53.721804 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 10:47:53.721804 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 10:47:53.721804 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 10:47:53.721804 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 10:47:53.721804 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 10:47:53.721804 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 10:47:53.721804 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 10:47:53.721804 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a216c772-a5f6-49e1-8496-8c71e53a1e8f could not be found. (HTTP 404) (Request-ID: req-5c950381-cf07-4a6f-95d8-8195f82b39cc) Jul 21 10:47:53.721804 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:47:53.721804 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:47:53.721804 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:47:53.725170 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:47:53.725170 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 21 10:47:53.725170 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 21 10:47:53.725170 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 10:47:53.725170 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 10:47:53.725170 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 21 10:47:53.725170 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 21 10:47:53.725170 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 21 10:47:53.725170 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 21 10:47:53.725170 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 10:47:53.725170 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 10:47:53.725170 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 21 10:47:53.725170 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 21 10:47:53.725170 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 21 10:47:53.725170 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 21 10:47:53.725170 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 10:47:53.725170 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 10:47:53.725170 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 10:47:53.725170 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 10:47:53.726173 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 10:47:53.726173 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 10:47:53.726173 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 10:47:53.726173 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 10:47:53.726173 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a216c772-a5f6-49e1-8496-8c71e53a1e8f could not be found. Jul 21 10:47:53.726173 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:47:53.726173 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:47:53.726173 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:47:53.726173 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:47:53.726173 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:47:53.726173 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:47:53.726173 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 10:47:53.726173 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 10:47:53.726173 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 10:47:53.726173 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 10:47:53.726173 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 10:47:53.726173 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 10:47:53.726173 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 21 10:47:53.726173 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 10:47:53.728331 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a216c772-a5f6-49e1-8496-8c71e53a1e8f could not be found. Jul 21 10:47:53.728331 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:47:53.728331 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:47:53.728331 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:47:53.728331 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:47:53.728331 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:47:53.728331 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:47:53.728331 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 10:47:53.728331 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 10:47:53.728331 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a216c772-a5f6-49e1-8496-8c71e53a1e8f could not be found. Jul 21 10:47:53.728331 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:47:53.728331 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-d70d1ade-d065-4b39-9e4d-a5cde8dc7412 tempest-VolumesGetTestJSON-867501968 tempest-VolumesGetTestJSON-867501968-project] Returning 404 to user: Volume a216c772-a5f6-49e1-8496-8c71e53a1e8f could not be found. {{(pid=124867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 10:47:53.728331 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-d70d1ade-d065-4b39-9e4d-a5cde8dc7412 tempest-VolumesGetTestJSON-867501968 tempest-VolumesGetTestJSON-867501968-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/a216c772-a5f6-49e1-8496-8c71e53a1e8f" status: 404 len: 109 microversion: 2.1 time: 0.048640 Jul 21 10:47:53.728331 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 109/227] 10.222.0.48 () {58 vars in 1244 bytes} [Thu Jul 21 10:47:53 2022] GET /compute/v2.1/os-volumes/a216c772-a5f6-49e1-8496-8c71e53a1e8f => generated 109 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 10:47:53.735207 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-b1d8cf56-ff9d-4948-acb6-477fb73d61ef tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:47:53.736610 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-b1d8cf56-ff9d-4948-acb6-477fb73d61ef tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: 86715109-fd38-41f4-b384-a319c310fc44] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:47:53.739004 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_api:SELECT=52 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:47:53.745594 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b1d8cf56-ff9d-4948-acb6-477fb73d61ef tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:53.746213 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b1d8cf56-ff9d-4948-acb6-477fb73d61ef tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:53.747071 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b1d8cf56-ff9d-4948-acb6-477fb73d61ef tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:53.747518 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b1d8cf56-ff9d-4948-acb6-477fb73d61ef tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:53.910811 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-b1d8cf56-ff9d-4948-acb6-477fb73d61ef tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:53.922008 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-b1d8cf56-ff9d-4948-acb6-477fb73d61ef tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44" status: 200 len: 1522 microversion: 2.1 time: 0.190499 Jul 21 10:47:53.922634 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 119/228] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:47:53 2022] GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44 => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:47:54.940145 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-fb50ace6-66f8-4480-a9fe-0a74d7d71a54 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:47:54.940868 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-fb50ace6-66f8-4480-a9fe-0a74d7d71a54 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: 86715109-fd38-41f4-b384-a319c310fc44] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:47:54.942897 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:47:54.948230 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fb50ace6-66f8-4480-a9fe-0a74d7d71a54 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:54.948909 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fb50ace6-66f8-4480-a9fe-0a74d7d71a54 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:54.949978 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fb50ace6-66f8-4480-a9fe-0a74d7d71a54 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:54.950599 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fb50ace6-66f8-4480-a9fe-0a74d7d71a54 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:55.137164 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-fb50ace6-66f8-4480-a9fe-0a74d7d71a54 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:55.145579 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-fb50ace6-66f8-4480-a9fe-0a74d7d71a54 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44" status: 200 len: 1502 microversion: 2.1 time: 0.209725 Jul 21 10:47:55.146233 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 110/229] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:47:54 2022] GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44 => generated 1502 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:47:55.170463 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-8adec818-1e27-4d05-9cda-48edfa376e06 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:47:55.171200 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-8adec818-1e27-4d05-9cda-48edfa376e06 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: b7a76827-1907-4bf4-b27c-945b33b2316d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:47:55.177963 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8adec818-1e27-4d05-9cda-48edfa376e06 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:55.178483 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8adec818-1e27-4d05-9cda-48edfa376e06 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:55.179358 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8adec818-1e27-4d05-9cda-48edfa376e06 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:55.179800 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8adec818-1e27-4d05-9cda-48edfa376e06 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:55.372227 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-8adec818-1e27-4d05-9cda-48edfa376e06 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:55.380247 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-8adec818-1e27-4d05-9cda-48edfa376e06 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/b7a76827-1907-4bf4-b27c-945b33b2316d" status: 200 len: 1516 microversion: 2.1 time: 0.222228 Jul 21 10:47:55.380818 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 120/230] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:47:55 2022] GET /compute/v2.1/servers/b7a76827-1907-4bf4-b27c-945b33b2316d => generated 1516 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:47:59.319244 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-611dd55a-e0cc-4802-b108-8d40056cfbae tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:47:59.320433 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-611dd55a-e0cc-4802-b108-8d40056cfbae tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: b7a76827-1907-4bf4-b27c-945b33b2316d] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:47:59.327375 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-611dd55a-e0cc-4802-b108-8d40056cfbae tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:59.327596 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-611dd55a-e0cc-4802-b108-8d40056cfbae tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:59.328426 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-611dd55a-e0cc-4802-b108-8d40056cfbae tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:59.328857 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-611dd55a-e0cc-4802-b108-8d40056cfbae tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:59.352586 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.objects.instance [None req-611dd55a-e0cc-4802-b108-8d40056cfbae tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lazy-loading 'flavor' on Instance uuid b7a76827-1907-4bf4-b27c-945b33b2316d {{(pid=124867) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 10:47:59.590645 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-611dd55a-e0cc-4802-b108-8d40056cfbae tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "POST /compute/v2.1/servers/b7a76827-1907-4bf4-b27c-945b33b2316d/action" status: 200 len: 32 microversion: 2.1 time: 0.276361 Jul 21 10:47:59.593858 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 111/231] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 21 10:47:59 2022] POST /compute/v2.1/servers/b7a76827-1907-4bf4-b27c-945b33b2316d/action => generated 32 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 21 10:47:59.601075 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-e1587228-3a31-4d31-b1b6-7c6f7f2e33bd tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:47:59.602361 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-e1587228-3a31-4d31-b1b6-7c6f7f2e33bd tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: b7a76827-1907-4bf4-b27c-945b33b2316d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:47:59.610626 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e1587228-3a31-4d31-b1b6-7c6f7f2e33bd tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:59.611561 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e1587228-3a31-4d31-b1b6-7c6f7f2e33bd tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:59.612502 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e1587228-3a31-4d31-b1b6-7c6f7f2e33bd tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:47:59.613533 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e1587228-3a31-4d31-b1b6-7c6f7f2e33bd tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:47:59.756505 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-e1587228-3a31-4d31-b1b6-7c6f7f2e33bd tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:47:59.764816 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-e1587228-3a31-4d31-b1b6-7c6f7f2e33bd tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/b7a76827-1907-4bf4-b27c-945b33b2316d" status: 200 len: 1522 microversion: 2.1 time: 0.167874 Jul 21 10:47:59.765396 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 121/232] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:47:59 2022] GET /compute/v2.1/servers/b7a76827-1907-4bf4-b27c-945b33b2316d => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:48:00.783280 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-79bea214-9423-44c2-bf1d-941921f16e57 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:48:00.783978 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-79bea214-9423-44c2-bf1d-941921f16e57 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: b7a76827-1907-4bf4-b27c-945b33b2316d] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:48:00.792095 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-79bea214-9423-44c2-bf1d-941921f16e57 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:00.792533 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-79bea214-9423-44c2-bf1d-941921f16e57 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:00.793337 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-79bea214-9423-44c2-bf1d-941921f16e57 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:00.793767 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-79bea214-9423-44c2-bf1d-941921f16e57 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:00.939851 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-79bea214-9423-44c2-bf1d-941921f16e57 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:00.950193 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-79bea214-9423-44c2-bf1d-941921f16e57 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/b7a76827-1907-4bf4-b27c-945b33b2316d" status: 200 len: 1522 microversion: 2.1 time: 0.171644 Jul 21 10:48:00.950939 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 112/233] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:48:00 2022] GET /compute/v2.1/servers/b7a76827-1907-4bf4-b27c-945b33b2316d => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:48:01.968155 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-cfab647b-c196-4695-8752-42df0d49717b tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:48:01.968752 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-cfab647b-c196-4695-8752-42df0d49717b tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: b7a76827-1907-4bf4-b27c-945b33b2316d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:48:01.975500 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-cfab647b-c196-4695-8752-42df0d49717b tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:01.975939 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-cfab647b-c196-4695-8752-42df0d49717b tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:01.976686 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-cfab647b-c196-4695-8752-42df0d49717b tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:01.977115 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-cfab647b-c196-4695-8752-42df0d49717b tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:02.111224 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-cfab647b-c196-4695-8752-42df0d49717b tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:02.119148 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-cfab647b-c196-4695-8752-42df0d49717b tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/b7a76827-1907-4bf4-b27c-945b33b2316d" status: 200 len: 1522 microversion: 2.1 time: 0.154191 Jul 21 10:48:02.119726 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 122/234] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:48:01 2022] GET /compute/v2.1/servers/b7a76827-1907-4bf4-b27c-945b33b2316d => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:48:03.135728 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-8cbe187c-46c9-4586-b547-0a1a11e9c2a8 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:48:03.136245 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-8cbe187c-46c9-4586-b547-0a1a11e9c2a8 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: b7a76827-1907-4bf4-b27c-945b33b2316d] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:48:03.142209 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8cbe187c-46c9-4586-b547-0a1a11e9c2a8 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:03.142670 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8cbe187c-46c9-4586-b547-0a1a11e9c2a8 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:03.143420 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8cbe187c-46c9-4586-b547-0a1a11e9c2a8 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:03.143849 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8cbe187c-46c9-4586-b547-0a1a11e9c2a8 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:03.275486 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-8cbe187c-46c9-4586-b547-0a1a11e9c2a8 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:03.282964 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-8cbe187c-46c9-4586-b547-0a1a11e9c2a8 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/b7a76827-1907-4bf4-b27c-945b33b2316d" status: 200 len: 1522 microversion: 2.1 time: 0.151701 Jul 21 10:48:03.283530 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 113/235] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:48:03 2022] GET /compute/v2.1/servers/b7a76827-1907-4bf4-b27c-945b33b2316d => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:48:04.301171 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-ff75a0e6-9034-48f1-b131-3596467a7783 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:48:04.301777 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-ff75a0e6-9034-48f1-b131-3596467a7783 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: b7a76827-1907-4bf4-b27c-945b33b2316d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:48:04.309325 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ff75a0e6-9034-48f1-b131-3596467a7783 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:04.309774 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ff75a0e6-9034-48f1-b131-3596467a7783 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:04.310532 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ff75a0e6-9034-48f1-b131-3596467a7783 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:04.310995 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ff75a0e6-9034-48f1-b131-3596467a7783 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:04.447681 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-ff75a0e6-9034-48f1-b131-3596467a7783 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:04.455507 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-ff75a0e6-9034-48f1-b131-3596467a7783 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/b7a76827-1907-4bf4-b27c-945b33b2316d" status: 200 len: 1522 microversion: 2.1 time: 0.158401 Jul 21 10:48:04.455921 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 123/236] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:48:04 2022] GET /compute/v2.1/servers/b7a76827-1907-4bf4-b27c-945b33b2316d => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:48:05.473321 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-3263604c-c009-4050-818a-6f266565ea52 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:48:05.473925 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-3263604c-c009-4050-818a-6f266565ea52 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: b7a76827-1907-4bf4-b27c-945b33b2316d] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:48:05.479909 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3263604c-c009-4050-818a-6f266565ea52 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:05.480526 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3263604c-c009-4050-818a-6f266565ea52 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:05.481805 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3263604c-c009-4050-818a-6f266565ea52 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:05.482227 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3263604c-c009-4050-818a-6f266565ea52 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:05.613362 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-3263604c-c009-4050-818a-6f266565ea52 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:05.621470 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-3263604c-c009-4050-818a-6f266565ea52 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/b7a76827-1907-4bf4-b27c-945b33b2316d" status: 200 len: 1522 microversion: 2.1 time: 0.151683 Jul 21 10:48:05.622784 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 114/237] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:48:05 2022] GET /compute/v2.1/servers/b7a76827-1907-4bf4-b27c-945b33b2316d => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:48:06.639168 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-d69f85ca-59b3-4d59-9bae-152d3e647f56 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:48:06.639772 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-d69f85ca-59b3-4d59-9bae-152d3e647f56 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: b7a76827-1907-4bf4-b27c-945b33b2316d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:48:06.646442 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d69f85ca-59b3-4d59-9bae-152d3e647f56 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:06.646944 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d69f85ca-59b3-4d59-9bae-152d3e647f56 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:06.647704 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d69f85ca-59b3-4d59-9bae-152d3e647f56 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:06.648135 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d69f85ca-59b3-4d59-9bae-152d3e647f56 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:06.797446 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-d69f85ca-59b3-4d59-9bae-152d3e647f56 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:06.801430 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-d69f85ca-59b3-4d59-9bae-152d3e647f56 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/b7a76827-1907-4bf4-b27c-945b33b2316d" status: 200 len: 1522 microversion: 2.1 time: 0.166200 Jul 21 10:48:06.802002 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 124/238] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:48:06 2022] GET /compute/v2.1/servers/b7a76827-1907-4bf4-b27c-945b33b2316d => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:48:07.819654 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-b076aa5c-f82d-4ad6-bd76-c199874cae9b tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:48:07.820264 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-b076aa5c-f82d-4ad6-bd76-c199874cae9b tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: b7a76827-1907-4bf4-b27c-945b33b2316d] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:48:07.826673 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b076aa5c-f82d-4ad6-bd76-c199874cae9b tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:07.827125 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b076aa5c-f82d-4ad6-bd76-c199874cae9b tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:07.827904 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b076aa5c-f82d-4ad6-bd76-c199874cae9b tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:07.828339 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b076aa5c-f82d-4ad6-bd76-c199874cae9b tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:07.978382 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-b076aa5c-f82d-4ad6-bd76-c199874cae9b tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:07.986614 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-b076aa5c-f82d-4ad6-bd76-c199874cae9b tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/b7a76827-1907-4bf4-b27c-945b33b2316d" status: 200 len: 1522 microversion: 2.1 time: 0.170891 Jul 21 10:48:07.987193 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 115/239] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:48:07 2022] GET /compute/v2.1/servers/b7a76827-1907-4bf4-b27c-945b33b2316d => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:48:09.003718 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-d883ca1a-e2f7-4051-8dcc-8b5c8640dd4c tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:48:09.004294 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-d883ca1a-e2f7-4051-8dcc-8b5c8640dd4c tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: b7a76827-1907-4bf4-b27c-945b33b2316d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:48:09.010703 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d883ca1a-e2f7-4051-8dcc-8b5c8640dd4c tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:09.011156 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d883ca1a-e2f7-4051-8dcc-8b5c8640dd4c tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:09.012170 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d883ca1a-e2f7-4051-8dcc-8b5c8640dd4c tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:09.012658 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d883ca1a-e2f7-4051-8dcc-8b5c8640dd4c tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:09.150044 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-d883ca1a-e2f7-4051-8dcc-8b5c8640dd4c tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:09.158595 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-d883ca1a-e2f7-4051-8dcc-8b5c8640dd4c tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/b7a76827-1907-4bf4-b27c-945b33b2316d" status: 200 len: 1522 microversion: 2.1 time: 0.158537 Jul 21 10:48:09.159161 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 125/240] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:48:08 2022] GET /compute/v2.1/servers/b7a76827-1907-4bf4-b27c-945b33b2316d => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:48:10.176650 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-72ad49ed-683e-4b1b-8a90-52533a9116a3 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:48:10.177264 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-72ad49ed-683e-4b1b-8a90-52533a9116a3 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: b7a76827-1907-4bf4-b27c-945b33b2316d] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:48:10.184544 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-72ad49ed-683e-4b1b-8a90-52533a9116a3 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:10.184999 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-72ad49ed-683e-4b1b-8a90-52533a9116a3 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:10.185794 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-72ad49ed-683e-4b1b-8a90-52533a9116a3 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:10.186395 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-72ad49ed-683e-4b1b-8a90-52533a9116a3 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:10.552832 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-72ad49ed-683e-4b1b-8a90-52533a9116a3 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:10.562912 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-72ad49ed-683e-4b1b-8a90-52533a9116a3 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/b7a76827-1907-4bf4-b27c-945b33b2316d" status: 200 len: 1522 microversion: 2.1 time: 0.388923 Jul 21 10:48:10.567252 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 116/241] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:48:10 2022] GET /compute/v2.1/servers/b7a76827-1907-4bf4-b27c-945b33b2316d => generated 1522 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:48:11.588361 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-72822fe9-f390-46f4-8da0-8980939f978e tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:48:11.589069 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-72822fe9-f390-46f4-8da0-8980939f978e tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: b7a76827-1907-4bf4-b27c-945b33b2316d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:48:11.595919 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-72822fe9-f390-46f4-8da0-8980939f978e tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:11.596367 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-72822fe9-f390-46f4-8da0-8980939f978e tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:11.597136 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-72822fe9-f390-46f4-8da0-8980939f978e tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:11.597572 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-72822fe9-f390-46f4-8da0-8980939f978e tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:11.732675 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-72822fe9-f390-46f4-8da0-8980939f978e tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:11.740197 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-72822fe9-f390-46f4-8da0-8980939f978e tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/b7a76827-1907-4bf4-b27c-945b33b2316d" status: 200 len: 1522 microversion: 2.1 time: 0.155621 Jul 21 10:48:11.740768 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 126/242] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:48:11 2022] GET /compute/v2.1/servers/b7a76827-1907-4bf4-b27c-945b33b2316d => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:48:12.757832 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-7e1ce0c5-2c92-4679-9fdd-f98e0b9a64d6 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:48:12.758466 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-7e1ce0c5-2c92-4679-9fdd-f98e0b9a64d6 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: b7a76827-1907-4bf4-b27c-945b33b2316d] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:48:12.765596 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7e1ce0c5-2c92-4679-9fdd-f98e0b9a64d6 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:12.766066 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7e1ce0c5-2c92-4679-9fdd-f98e0b9a64d6 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:12.766898 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7e1ce0c5-2c92-4679-9fdd-f98e0b9a64d6 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:12.767331 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7e1ce0c5-2c92-4679-9fdd-f98e0b9a64d6 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:12.905891 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-7e1ce0c5-2c92-4679-9fdd-f98e0b9a64d6 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:12.913573 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-7e1ce0c5-2c92-4679-9fdd-f98e0b9a64d6 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/b7a76827-1907-4bf4-b27c-945b33b2316d" status: 200 len: 1522 microversion: 2.1 time: 0.159579 Jul 21 10:48:12.914130 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 117/243] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:48:12 2022] GET /compute/v2.1/servers/b7a76827-1907-4bf4-b27c-945b33b2316d => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:48:13.930219 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-98f8a923-0d60-4d4c-8acb-97badf34a8c7 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:48:13.935432 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-98f8a923-0d60-4d4c-8acb-97badf34a8c7 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: b7a76827-1907-4bf4-b27c-945b33b2316d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:48:13.937441 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-98f8a923-0d60-4d4c-8acb-97badf34a8c7 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:13.937919 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-98f8a923-0d60-4d4c-8acb-97badf34a8c7 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:13.938703 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-98f8a923-0d60-4d4c-8acb-97badf34a8c7 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:13.939144 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-98f8a923-0d60-4d4c-8acb-97badf34a8c7 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:14.065209 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-98f8a923-0d60-4d4c-8acb-97badf34a8c7 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:14.072586 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-98f8a923-0d60-4d4c-8acb-97badf34a8c7 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/b7a76827-1907-4bf4-b27c-945b33b2316d" status: 200 len: 1522 microversion: 2.1 time: 0.146338 Jul 21 10:48:14.073155 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 127/244] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:48:13 2022] GET /compute/v2.1/servers/b7a76827-1907-4bf4-b27c-945b33b2316d => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:48:15.092027 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-b5f486c8-df7a-41fa-a2dc-029cbd9683fa tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:48:15.092641 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-b5f486c8-df7a-41fa-a2dc-029cbd9683fa tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: b7a76827-1907-4bf4-b27c-945b33b2316d] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:48:15.099366 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b5f486c8-df7a-41fa-a2dc-029cbd9683fa tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:15.099823 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b5f486c8-df7a-41fa-a2dc-029cbd9683fa tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:15.100614 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b5f486c8-df7a-41fa-a2dc-029cbd9683fa tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:15.101030 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b5f486c8-df7a-41fa-a2dc-029cbd9683fa tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:15.108165 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:48:15.240994 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-b5f486c8-df7a-41fa-a2dc-029cbd9683fa tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:15.250549 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-b5f486c8-df7a-41fa-a2dc-029cbd9683fa tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/b7a76827-1907-4bf4-b27c-945b33b2316d" status: 200 len: 1522 microversion: 2.1 time: 0.163844 Jul 21 10:48:15.251320 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 118/245] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:48:15 2022] GET /compute/v2.1/servers/b7a76827-1907-4bf4-b27c-945b33b2316d => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:48:16.267959 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-ddabf9f9-f4ae-45e7-931c-37b9b4821387 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:48:16.268566 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-ddabf9f9-f4ae-45e7-931c-37b9b4821387 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: b7a76827-1907-4bf4-b27c-945b33b2316d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:48:16.275113 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ddabf9f9-f4ae-45e7-931c-37b9b4821387 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:16.275561 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ddabf9f9-f4ae-45e7-931c-37b9b4821387 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:16.276344 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ddabf9f9-f4ae-45e7-931c-37b9b4821387 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:16.276801 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ddabf9f9-f4ae-45e7-931c-37b9b4821387 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:16.280778 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell1:SELECT=81 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:48:16.410296 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-ddabf9f9-f4ae-45e7-931c-37b9b4821387 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:16.418501 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-ddabf9f9-f4ae-45e7-931c-37b9b4821387 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/b7a76827-1907-4bf4-b27c-945b33b2316d" status: 200 len: 1522 microversion: 2.1 time: 0.154189 Jul 21 10:48:16.419502 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 128/246] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:48:16 2022] GET /compute/v2.1/servers/b7a76827-1907-4bf4-b27c-945b33b2316d => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:48:17.437946 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-0335e9ed-f0d6-4876-971e-7a0426ff8e7d tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:48:17.439281 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-0335e9ed-f0d6-4876-971e-7a0426ff8e7d tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: b7a76827-1907-4bf4-b27c-945b33b2316d] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:48:17.446579 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0335e9ed-f0d6-4876-971e-7a0426ff8e7d tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:17.447185 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0335e9ed-f0d6-4876-971e-7a0426ff8e7d tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:17.447955 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0335e9ed-f0d6-4876-971e-7a0426ff8e7d tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:17.448383 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0335e9ed-f0d6-4876-971e-7a0426ff8e7d tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:17.601868 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-0335e9ed-f0d6-4876-971e-7a0426ff8e7d tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:17.610396 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-0335e9ed-f0d6-4876-971e-7a0426ff8e7d tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/b7a76827-1907-4bf4-b27c-945b33b2316d" status: 200 len: 1502 microversion: 2.1 time: 0.176984 Jul 21 10:48:17.611064 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 119/247] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:48:17 2022] GET /compute/v2.1/servers/b7a76827-1907-4bf4-b27c-945b33b2316d => generated 1502 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:48:17.627482 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-3203c8cf-1f35-4600-a662-e24156d70662 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "63223630-ec1d-4bd8-81df-286b8d0c891e"}} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:48:17.631871 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-3203c8cf-1f35-4600-a662-e24156d70662 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: b7a76827-1907-4bf4-b27c-945b33b2316d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:48:17.635095 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3203c8cf-1f35-4600-a662-e24156d70662 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:17.639579 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3203c8cf-1f35-4600-a662-e24156d70662 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:17.639579 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3203c8cf-1f35-4600-a662-e24156d70662 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:17.639579 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3203c8cf-1f35-4600-a662-e24156d70662 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:17.661987 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.wsgi [None req-3203c8cf-1f35-4600-a662-e24156d70662 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] HTTP exception thrown: Cannot 'attach_volume' instance b7a76827-1907-4bf4-b27c-945b33b2316d while it is in vm_state rescued Jul 21 10:48:17.664037 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-3203c8cf-1f35-4600-a662-e24156d70662 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Request method failure captured: Jul 21 10:48:17.664037 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: request: POST /compute/v2.1/servers/b7a76827-1907-4bf4-b27c-945b33b2316d/os-volume_attachments HTTP/1.1 Jul 21 10:48:17.664037 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Accept: application/json Jul 21 10:48:17.664037 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Accept-Encoding: identity Jul 21 10:48:17.664037 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Connection: close Jul 21 10:48:17.664037 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Content-Length: 74 Jul 21 10:48:17.664037 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Content-Type: application/json Jul 21 10:48:17.664037 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Host: 10.222.0.48 Jul 21 10:48:17.664037 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Openstack-System-Scope: None Jul 21 10:48:17.664037 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: User-Agent: python-urllib3/1.26.9 Jul 21 10:48:17.664037 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Auth-Token: gAAAAABi2S6Ceh_4nWphJ8VOdl6H8HFNXSa-qaDU7JzSMyQFmKOVC1-s9RjoIDnnf0b6XhBtJZfkFCZ33MTu8R7SDlIHJinmYsY2WkcMWq4PFgA7k0PzgcXzqdQyXpT96ot3T9mRIIjamqovKw8w4rfRBreiHT2xSl4dltciMM60bd0k4iI4qGs Jul 21 10:48:17.664037 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Domain-Id: None Jul 21 10:48:17.664037 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Domain-Name: None Jul 21 10:48:17.664037 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Identity-Status: Confirmed Jul 21 10:48:17.664037 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Is-Admin-Project: True Jul 21 10:48:17.664037 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Domain-Id: default Jul 21 10:48:17.664037 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Domain-Name: Default Jul 21 10:48:17.664037 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Id: 2ff45af5bd82457b9fd080026ea65b5b Jul 21 10:48:17.664037 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1176570364 Jul 21 10:48:17.664037 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Role: reader,member Jul 21 10:48:17.664037 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Roles: reader,member Jul 21 10:48:17.665564 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2ff45af5bd82457b9fd080026ea65b5b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2ff45af5bd82457b9fd080026ea65b5b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2ff45af5bd82457b9fd080026ea65b5b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2ff45af5bd82457b9fd080026ea65b5b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] Jul 21 10:48:17.665564 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1176570364 Jul 21 10:48:17.665564 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Tenant-Id: 2ff45af5bd82457b9fd080026ea65b5b Jul 21 10:48:17.665564 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1176570364 Jul 21 10:48:17.665564 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User: tempest-ServerRescueNegativeTestJSON-1176570364-project Jul 21 10:48:17.665564 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Domain-Id: default Jul 21 10:48:17.665564 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Domain-Name: Default Jul 21 10:48:17.665564 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Id: a2cb1079722947dfa37946c03b7297a3 Jul 21 10:48:17.665564 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1176570364-project Jul 21 10:48:17.665564 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Jul 21 10:48:17.665564 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: {"volumeAttachment": {"volumeId": "63223630-ec1d-4bd8-81df-286b8d0c891e"}} Jul 21 10:48:17.665564 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: method: > Jul 21 10:48:17.666429 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: exception: Cannot 'attach_volume' instance b7a76827-1907-4bf4-b27c-945b33b2316d while it is in vm_state rescued Jul 21 10:48:17.666429 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: action_args: {'server_id': 'b7a76827-1907-4bf4-b27c-945b33b2316d', 'body': {'volumeAttachment': {'volumeId': '63223630-ec1d-4bd8-81df-286b8d0c891e'}}} Jul 21 10:48:17.666429 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 10:48:17.666429 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:48:17.666429 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 21 10:48:17.666429 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 21 10:48:17.666429 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 21 10:48:17.666429 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 21 10:48:17.666429 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 21 10:48:17.666429 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 21 10:48:17.666429 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b7a76827-1907-4bf4-b27c-945b33b2316d in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 21 10:48:17.666429 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:48:17.666429 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:48:17.666429 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:48:17.666429 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:48:17.666429 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:48:17.666429 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:48:17.666429 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 10:48:17.666429 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 10:48:17.668226 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 10:48:17.668226 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 10:48:17.668226 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 21 10:48:17.668226 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 10:48:17.668226 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 21 10:48:17.668226 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 10:48:17.668226 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 21 10:48:17.668226 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 10:48:17.668226 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 21 10:48:17.668226 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 21 10:48:17.668226 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 21 10:48:17.668226 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 21 10:48:17.668226 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance b7a76827-1907-4bf4-b27c-945b33b2316d while it is in vm_state rescued Jul 21 10:48:17.668226 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:48:17.668226 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:48:17.668226 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:48:17.668226 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:48:17.668226 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:48:17.668226 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:48:17.669234 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 10:48:17.669234 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 10:48:17.669234 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance b7a76827-1907-4bf4-b27c-945b33b2316d while it is in vm_state rescued Jul 21 10:48:17.669234 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:48:17.669234 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-3203c8cf-1f35-4600-a662-e24156d70662 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Returning 409 to user: Cannot 'attach_volume' instance b7a76827-1907-4bf4-b27c-945b33b2316d while it is in vm_state rescued {{(pid=124868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 10:48:17.669234 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-3203c8cf-1f35-4600-a662-e24156d70662 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "POST /compute/v2.1/servers/b7a76827-1907-4bf4-b27c-945b33b2316d/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.042451 Jul 21 10:48:17.669234 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 129/248] 10.222.0.48 () {60 vars in 1322 bytes} [Thu Jul 21 10:48:17 2022] POST /compute/v2.1/servers/b7a76827-1907-4bf4-b27c-945b33b2316d/os-volume_attachments => generated 152 bytes in 44 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 21 10:48:17.676798 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-e561c412-b895-4fc2-b869-b2451557995e tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:48:17.677353 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-e561c412-b895-4fc2-b869-b2451557995e tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: b7a76827-1907-4bf4-b27c-945b33b2316d] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:48:17.683614 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e561c412-b895-4fc2-b869-b2451557995e tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:17.684062 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e561c412-b895-4fc2-b869-b2451557995e tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:17.685007 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e561c412-b895-4fc2-b869-b2451557995e tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:17.685602 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e561c412-b895-4fc2-b869-b2451557995e tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:17.905055 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-e561c412-b895-4fc2-b869-b2451557995e tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "POST /compute/v2.1/servers/b7a76827-1907-4bf4-b27c-945b33b2316d/action" status: 202 len: 0 microversion: 2.1 time: 0.231323 Jul 21 10:48:17.905950 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 120/249] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 21 10:48:17 2022] POST /compute/v2.1/servers/b7a76827-1907-4bf4-b27c-945b33b2316d/action => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 21 10:48:17.925013 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-1fbd52f6-7ad4-48fa-ab7d-d34e750ca4fa tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:48:17.925847 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-1fbd52f6-7ad4-48fa-ab7d-d34e750ca4fa tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: b7a76827-1907-4bf4-b27c-945b33b2316d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:48:17.932778 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1fbd52f6-7ad4-48fa-ab7d-d34e750ca4fa tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:17.935606 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1fbd52f6-7ad4-48fa-ab7d-d34e750ca4fa tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:17.935606 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1fbd52f6-7ad4-48fa-ab7d-d34e750ca4fa tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:17.935606 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1fbd52f6-7ad4-48fa-ab7d-d34e750ca4fa tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:18.081402 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-1fbd52f6-7ad4-48fa-ab7d-d34e750ca4fa tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:18.091215 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-1fbd52f6-7ad4-48fa-ab7d-d34e750ca4fa tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/b7a76827-1907-4bf4-b27c-945b33b2316d" status: 200 len: 1510 microversion: 2.1 time: 0.177874 Jul 21 10:48:18.091851 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 130/250] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:48:17 2022] GET /compute/v2.1/servers/b7a76827-1907-4bf4-b27c-945b33b2316d => generated 1510 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:48:19.111452 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-65e04907-b6fe-44fc-a170-a0427221d431 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:48:19.112155 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-65e04907-b6fe-44fc-a170-a0427221d431 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: b7a76827-1907-4bf4-b27c-945b33b2316d] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:48:19.118640 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-65e04907-b6fe-44fc-a170-a0427221d431 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:19.119086 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-65e04907-b6fe-44fc-a170-a0427221d431 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:19.119960 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-65e04907-b6fe-44fc-a170-a0427221d431 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:19.121149 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-65e04907-b6fe-44fc-a170-a0427221d431 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:19.278097 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-65e04907-b6fe-44fc-a170-a0427221d431 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:19.285990 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-65e04907-b6fe-44fc-a170-a0427221d431 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/b7a76827-1907-4bf4-b27c-945b33b2316d" status: 200 len: 1510 microversion: 2.1 time: 0.179152 Jul 21 10:48:19.289613 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 121/251] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:48:19 2022] GET /compute/v2.1/servers/b7a76827-1907-4bf4-b27c-945b33b2316d => generated 1510 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:48:20.307600 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-7bc354c6-d520-481d-a1f3-19165fd79a0a tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:48:20.309483 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-7bc354c6-d520-481d-a1f3-19165fd79a0a tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: b7a76827-1907-4bf4-b27c-945b33b2316d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:48:20.318065 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7bc354c6-d520-481d-a1f3-19165fd79a0a tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:20.318065 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7bc354c6-d520-481d-a1f3-19165fd79a0a tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:20.324454 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7bc354c6-d520-481d-a1f3-19165fd79a0a tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:20.324454 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7bc354c6-d520-481d-a1f3-19165fd79a0a tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:20.468738 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-7bc354c6-d520-481d-a1f3-19165fd79a0a tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:20.476907 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-7bc354c6-d520-481d-a1f3-19165fd79a0a tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/b7a76827-1907-4bf4-b27c-945b33b2316d" status: 200 len: 1510 microversion: 2.1 time: 0.174948 Jul 21 10:48:20.477472 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 131/252] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:48:20 2022] GET /compute/v2.1/servers/b7a76827-1907-4bf4-b27c-945b33b2316d => generated 1510 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:48:21.495942 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-9c56b0bb-4e23-4dab-bf51-44c49031ad75 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:48:21.496626 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-9c56b0bb-4e23-4dab-bf51-44c49031ad75 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: b7a76827-1907-4bf4-b27c-945b33b2316d] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:48:21.502758 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9c56b0bb-4e23-4dab-bf51-44c49031ad75 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:21.503200 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9c56b0bb-4e23-4dab-bf51-44c49031ad75 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:21.503962 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9c56b0bb-4e23-4dab-bf51-44c49031ad75 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:21.504387 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9c56b0bb-4e23-4dab-bf51-44c49031ad75 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:21.645042 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-9c56b0bb-4e23-4dab-bf51-44c49031ad75 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:21.653838 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-9c56b0bb-4e23-4dab-bf51-44c49031ad75 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/b7a76827-1907-4bf4-b27c-945b33b2316d" status: 200 len: 1510 microversion: 2.1 time: 0.161826 Jul 21 10:48:21.654434 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 122/253] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:48:21 2022] GET /compute/v2.1/servers/b7a76827-1907-4bf4-b27c-945b33b2316d => generated 1510 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:48:22.671878 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-64b6189a-186c-423f-8a50-7789fe08e78b tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:48:22.672504 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-64b6189a-186c-423f-8a50-7789fe08e78b tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: b7a76827-1907-4bf4-b27c-945b33b2316d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:48:22.679092 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-64b6189a-186c-423f-8a50-7789fe08e78b tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:22.679556 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-64b6189a-186c-423f-8a50-7789fe08e78b tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:22.680397 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-64b6189a-186c-423f-8a50-7789fe08e78b tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:22.680832 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-64b6189a-186c-423f-8a50-7789fe08e78b tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:22.822119 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-64b6189a-186c-423f-8a50-7789fe08e78b tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:22.830432 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-64b6189a-186c-423f-8a50-7789fe08e78b tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/b7a76827-1907-4bf4-b27c-945b33b2316d" status: 200 len: 1510 microversion: 2.1 time: 0.162925 Jul 21 10:48:22.831101 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 132/254] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:48:22 2022] GET /compute/v2.1/servers/b7a76827-1907-4bf4-b27c-945b33b2316d => generated 1510 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:48:23.852294 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-86d00564-3567-4577-976d-fa5758a9f4e1 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:48:23.852900 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-86d00564-3567-4577-976d-fa5758a9f4e1 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: b7a76827-1907-4bf4-b27c-945b33b2316d] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:48:23.859805 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-86d00564-3567-4577-976d-fa5758a9f4e1 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:23.860258 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-86d00564-3567-4577-976d-fa5758a9f4e1 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:23.861031 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-86d00564-3567-4577-976d-fa5758a9f4e1 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:23.861463 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-86d00564-3567-4577-976d-fa5758a9f4e1 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:24.075667 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-86d00564-3567-4577-976d-fa5758a9f4e1 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:24.089826 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-86d00564-3567-4577-976d-fa5758a9f4e1 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/b7a76827-1907-4bf4-b27c-945b33b2316d" status: 200 len: 1510 microversion: 2.1 time: 0.236610 Jul 21 10:48:24.092999 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 123/255] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:48:23 2022] GET /compute/v2.1/servers/b7a76827-1907-4bf4-b27c-945b33b2316d => generated 1510 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:48:24.923745 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-5fcffbe6-e919-404c-b636-9b5e72b458f8 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:48:24.924402 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-5fcffbe6-e919-404c-b636-9b5e72b458f8 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:48:24.930529 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_api:SELECT=28 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:48:24.932544 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5fcffbe6-e919-404c-b636-9b5e72b458f8 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:24.933115 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5fcffbe6-e919-404c-b636-9b5e72b458f8 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:24.933823 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5fcffbe6-e919-404c-b636-9b5e72b458f8 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:24.934257 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5fcffbe6-e919-404c-b636-9b5e72b458f8 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:24.960168 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-5fcffbe6-e919-404c-b636-9b5e72b458f8 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d/ips" status: 200 len: 151 microversion: 2.20 time: 0.040386 Jul 21 10:48:24.960753 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 133/256] 10.222.0.48 () {60 vars in 1288 bytes} [Thu Jul 21 10:48:24 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d/ips => generated 151 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 10:48:25.107680 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-6bfc4687-5150-4de6-beac-dce1fe172aff tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:48:25.108907 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-6bfc4687-5150-4de6-beac-dce1fe172aff tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: b7a76827-1907-4bf4-b27c-945b33b2316d] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:48:25.115161 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6bfc4687-5150-4de6-beac-dce1fe172aff tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:25.115612 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6bfc4687-5150-4de6-beac-dce1fe172aff tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:25.116375 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6bfc4687-5150-4de6-beac-dce1fe172aff tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:25.116982 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6bfc4687-5150-4de6-beac-dce1fe172aff tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:25.320723 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-6bfc4687-5150-4de6-beac-dce1fe172aff tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:25.337330 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-6bfc4687-5150-4de6-beac-dce1fe172aff tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/b7a76827-1907-4bf4-b27c-945b33b2316d" status: 200 len: 1516 microversion: 2.1 time: 0.228355 Jul 21 10:48:25.337330 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 124/257] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:48:25 2022] GET /compute/v2.1/servers/b7a76827-1907-4bf4-b27c-945b33b2316d => generated 1516 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:48:27.489302 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-48eab048-1b1f-48de-877c-ca5dccb78749 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Action: 'create', calling method: .version_select at 0x7f79634124c0>, body: {"keypair": {"name": "tempest-keypair-1487295281", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFe5N2XcsynuCjOkeDDcjkOObRestzNCKSu50FVDiREbO6j7Fz249/h4nYbY59pZcdyne/HgLeRR/Os3qbYKDNmlPxIegH5ycUT89USNJOuia6rzNFa7BZf8RHpd8MT5DQ=="}} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:48:27.510032 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.quota [None req-48eab048-1b1f-48de-877c-ca5dccb78749 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Getting quotas for project 2ff45af5bd82457b9fd080026ea65b5b. Resources: {'key_pairs'} {{(pid=124868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 10:48:27.514483 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.quota [None req-48eab048-1b1f-48de-877c-ca5dccb78749 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Getting quotas for user a2cb1079722947dfa37946c03b7297a3 and project 2ff45af5bd82457b9fd080026ea65b5b. Resources: {'key_pairs'} {{(pid=124868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 10:48:27.627404 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-48eab048-1b1f-48de-877c-ca5dccb78749 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.141764 Jul 21 10:48:27.627913 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 134/258] 10.222.0.48 () {60 vars in 1158 bytes} [Thu Jul 21 10:48:27 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:48:28.177560 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-a708787f-a288-4aee-819d-fb9ee7ac1372 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:48:28.178219 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-a708787f-a288-4aee-819d-fb9ee7ac1372 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:48:28.187099 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a708787f-a288-4aee-819d-fb9ee7ac1372 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:28.187099 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a708787f-a288-4aee-819d-fb9ee7ac1372 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:28.187277 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a708787f-a288-4aee-819d-fb9ee7ac1372 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:28.187596 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a708787f-a288-4aee-819d-fb9ee7ac1372 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:28.419756 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.objects.instance [None req-a708787f-a288-4aee-819d-fb9ee7ac1372 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lazy-loading 'flavor' on Instance uuid 1e730525-7ce4-4a5a-8023-84cae6b1da3d {{(pid=124867) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 10:48:29.239798 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-a708787f-a288-4aee-819d-fb9ee7ac1372 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "POST /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d/action" status: 202 len: 0 microversion: 2.20 time: 1.065941 Jul 21 10:48:29.242044 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 125/259] 10.222.0.48 () {62 vars in 1318 bytes} [Thu Jul 21 10:48:28 2022] POST /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d/action => generated 0 bytes in 1067 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 21 10:48:29.249918 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-24489927-1c2c-4fa7-907e-481a96314cb5 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:48:29.250533 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-24489927-1c2c-4fa7-907e-481a96314cb5 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:48:29.257142 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-24489927-1c2c-4fa7-907e-481a96314cb5 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:29.264926 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-24489927-1c2c-4fa7-907e-481a96314cb5 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:29.264926 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-24489927-1c2c-4fa7-907e-481a96314cb5 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:29.264926 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-24489927-1c2c-4fa7-907e-481a96314cb5 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:29.499836 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-24489927-1c2c-4fa7-907e-481a96314cb5 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:29.509326 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-24489927-1c2c-4fa7-907e-481a96314cb5 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:29.511155 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-24489927-1c2c-4fa7-907e-481a96314cb5 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:29.513928 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-24489927-1c2c-4fa7-907e-481a96314cb5 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1723 microversion: 2.20 time: 0.268880 Jul 21 10:48:29.515150 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-91ee36bb-0777-4955-8350-8d46d34d6a11 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1778989685", "imageRef": "282ddb30-fa0f-489d-9cc3-a3e70e03c631", "flavorRef": "452", "networks": [{"uuid": "b613594b-0f24-4b36-a4b2-dcc23406f4ab"}]}} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:48:29.520986 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 135/260] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:48:29 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1723 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:48:29.522656 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_api:SELECT=32 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:48:29.604871 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.network.neutron [None req-91ee36bb-0777-4955-8350-8d46d34d6a11 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] validate_networks() for [('b613594b-0f24-4b36-a4b2-dcc23406f4ab', None, None, None, None, None)] {{(pid=124867) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 10:48:30.279772 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-91ee36bb-0777-4955-8350-8d46d34d6a11 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Flavor limits 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 10:48:30.281168 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-91ee36bb-0777-4955-8350-8d46d34d6a11 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Image limits 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 10:48:30.281810 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-91ee36bb-0777-4955-8350-8d46d34d6a11 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Flavor pref 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 10:48:30.282370 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-91ee36bb-0777-4955-8350-8d46d34d6a11 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Image pref 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 10:48:30.282951 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-91ee36bb-0777-4955-8350-8d46d34d6a11 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 10:48:30.313758 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-91ee36bb-0777-4955-8350-8d46d34d6a11 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:30.314738 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-91ee36bb-0777-4955-8350-8d46d34d6a11 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:30.316855 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-91ee36bb-0777-4955-8350-8d46d34d6a11 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:30.317741 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-91ee36bb-0777-4955-8350-8d46d34d6a11 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:30.337489 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.quota [None req-91ee36bb-0777-4955-8350-8d46d34d6a11 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Getting quotas for project 24d5a2477eb74d5da5911b37f9031110. Resources: {'ram', 'instances', 'cores'} {{(pid=124867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 10:48:30.342833 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.quota [None req-91ee36bb-0777-4955-8350-8d46d34d6a11 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Getting quotas for user 26ccc2d61c7045a8abba95e7cd002a0a and project 24d5a2477eb74d5da5911b37f9031110. Resources: {'ram', 'instances', 'cores'} {{(pid=124867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 10:48:30.356160 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-91ee36bb-0777-4955-8350-8d46d34d6a11 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Going to run 1 instances... {{(pid=124867) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 10:48:30.358454 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-91ee36bb-0777-4955-8350-8d46d34d6a11 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] [instance: dc183ff4-10bd-4827-a6a8-17f6b6d739be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='282ddb30-fa0f-489d-9cc3-a3e70e03c631',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124867) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 10:48:30.525517 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-91ee36bb-0777-4955-8350-8d46d34d6a11 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.021039 Jul 21 10:48:30.533056 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-c32943bc-41ba-452a-82e1-998cbdc1691a tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:48:30.534181 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-c32943bc-41ba-452a-82e1-998cbdc1691a tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:48:30.540823 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c32943bc-41ba-452a-82e1-998cbdc1691a tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:30.545170 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 126/261] 10.222.0.48 () {60 vars in 1146 bytes} [Thu Jul 21 10:48:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1038 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 21 10:48:30.545305 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c32943bc-41ba-452a-82e1-998cbdc1691a tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:30.545305 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c32943bc-41ba-452a-82e1-998cbdc1691a tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:30.545305 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c32943bc-41ba-452a-82e1-998cbdc1691a tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:30.552259 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-62ea5226-cebd-47f1-af94-86e4bac8785f tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:48:30.552873 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-62ea5226-cebd-47f1-af94-86e4bac8785f tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] [instance: dc183ff4-10bd-4827-a6a8-17f6b6d739be] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:48:30.650227 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-62ea5226-cebd-47f1-af94-86e4bac8785f tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ccc2d61c7045a8abba95e7cd002a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24d5a2477eb74d5da5911b37f9031110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:30.658978 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-62ea5226-cebd-47f1-af94-86e4bac8785f tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] 10.222.0.48 "GET /compute/v2.1/servers/dc183ff4-10bd-4827-a6a8-17f6b6d739be" status: 200 len: 1219 microversion: 2.1 time: 0.110395 Jul 21 10:48:30.659770 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 127/262] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:48:30 2022] GET /compute/v2.1/servers/dc183ff4-10bd-4827-a6a8-17f6b6d739be => generated 1219 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:48:30.827479 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-c32943bc-41ba-452a-82e1-998cbdc1691a tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:30.841184 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-c32943bc-41ba-452a-82e1-998cbdc1691a tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:30.844572 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-c32943bc-41ba-452a-82e1-998cbdc1691a tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:30.846338 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-c32943bc-41ba-452a-82e1-998cbdc1691a tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1723 microversion: 2.20 time: 0.317357 Jul 21 10:48:30.850885 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 136/263] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:48:30 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1723 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 10:48:31.327373 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-1ee6dc42-b811-4c4e-9081-917262b56bb1 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1666365865", "imageRef": "282ddb30-fa0f-489d-9cc3-a3e70e03c631", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c6051ff4-8399-4b19-9b2a-895d18fcb35a"}], "security_groups": [{"name": "tempest-securitygroup--1141179192"}], "key_name": "tempest-keypair-1487295281", "user_data": "}} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:48:31.440650 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.network.neutron [None req-1ee6dc42-b811-4c4e-9081-917262b56bb1 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] validate_networks() for [('c6051ff4-8399-4b19-9b2a-895d18fcb35a', None, None, None, None, None)] {{(pid=124867) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 10:48:31.676516 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-88aa522c-2601-4585-a137-0ecd9057dc05 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:48:31.677236 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-88aa522c-2601-4585-a137-0ecd9057dc05 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] [instance: dc183ff4-10bd-4827-a6a8-17f6b6d739be] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:48:31.780738 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-88aa522c-2601-4585-a137-0ecd9057dc05 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ccc2d61c7045a8abba95e7cd002a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24d5a2477eb74d5da5911b37f9031110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:31.798130 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-88aa522c-2601-4585-a137-0ecd9057dc05 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] 10.222.0.48 "GET /compute/v2.1/servers/dc183ff4-10bd-4827-a6a8-17f6b6d739be" status: 200 len: 1219 microversion: 2.1 time: 0.117774 Jul 21 10:48:31.798130 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 137/264] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:48:31 2022] GET /compute/v2.1/servers/dc183ff4-10bd-4827-a6a8-17f6b6d739be => generated 1219 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:48:31.865844 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-09a238e5-bfe1-4b89-84bb-679b378c97ec tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:48:31.866645 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-09a238e5-bfe1-4b89-84bb-679b378c97ec tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:48:31.874267 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-09a238e5-bfe1-4b89-84bb-679b378c97ec tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:31.874742 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-09a238e5-bfe1-4b89-84bb-679b378c97ec tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:31.875508 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-09a238e5-bfe1-4b89-84bb-679b378c97ec tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:31.876106 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-09a238e5-bfe1-4b89-84bb-679b378c97ec tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:32.014522 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-1ee6dc42-b811-4c4e-9081-917262b56bb1 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Flavor limits 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 10:48:32.015526 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-1ee6dc42-b811-4c4e-9081-917262b56bb1 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Image limits 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 10:48:32.015526 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-1ee6dc42-b811-4c4e-9081-917262b56bb1 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Flavor pref 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 10:48:32.016164 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-1ee6dc42-b811-4c4e-9081-917262b56bb1 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Image pref 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 10:48:32.016672 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-1ee6dc42-b811-4c4e-9081-917262b56bb1 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 10:48:32.028664 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1ee6dc42-b811-4c4e-9081-917262b56bb1 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:32.029233 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1ee6dc42-b811-4c4e-9081-917262b56bb1 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:32.030966 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1ee6dc42-b811-4c4e-9081-917262b56bb1 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:32.032134 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1ee6dc42-b811-4c4e-9081-917262b56bb1 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:32.049988 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.quota [None req-1ee6dc42-b811-4c4e-9081-917262b56bb1 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Getting quotas for project 2ff45af5bd82457b9fd080026ea65b5b. Resources: {'ram', 'instances', 'cores'} {{(pid=124867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 10:48:32.054260 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.quota [None req-1ee6dc42-b811-4c4e-9081-917262b56bb1 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Getting quotas for user a2cb1079722947dfa37946c03b7297a3 and project 2ff45af5bd82457b9fd080026ea65b5b. Resources: {'ram', 'instances', 'cores'} {{(pid=124867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 10:48:32.069010 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-1ee6dc42-b811-4c4e-9081-917262b56bb1 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Going to run 1 instances... {{(pid=124867) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 10:48:32.071556 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-1ee6dc42-b811-4c4e-9081-917262b56bb1 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: a54643be-3f53-4fe5-bab0-786b71d627bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='282ddb30-fa0f-489d-9cc3-a3e70e03c631',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124867) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 10:48:32.079581 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-09a238e5-bfe1-4b89-84bb-679b378c97ec tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:32.090741 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-09a238e5-bfe1-4b89-84bb-679b378c97ec tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:32.092617 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-09a238e5-bfe1-4b89-84bb-679b378c97ec tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:32.093904 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-09a238e5-bfe1-4b89-84bb-679b378c97ec tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1723 microversion: 2.20 time: 0.232574 Jul 21 10:48:32.094913 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 138/265] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:48:31 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1723 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 10:48:32.257179 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-1ee6dc42-b811-4c4e-9081-917262b56bb1 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.934384 Jul 21 10:48:32.257824 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 128/266] 10.222.0.48 () {60 vars in 1146 bytes} [Thu Jul 21 10:48:31 2022] POST /compute/v2.1/servers => generated 409 bytes in 936 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 10:48:32.268870 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-32a5dbdf-9f72-4dea-9da5-920120c0d14d tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:48:32.269540 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-32a5dbdf-9f72-4dea-9da5-920120c0d14d tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: a54643be-3f53-4fe5-bab0-786b71d627bb] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:48:32.332209 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-32a5dbdf-9f72-4dea-9da5-920120c0d14d tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:32.340039 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-32a5dbdf-9f72-4dea-9da5-920120c0d14d tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb" status: 200 len: 1246 microversion: 2.1 time: 0.074936 Jul 21 10:48:32.340852 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 139/267] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:48:32 2022] GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb => generated 1246 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:48:32.815678 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-ba1c4033-4e46-4878-89b1-66005e1526d4 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:48:32.816294 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-ba1c4033-4e46-4878-89b1-66005e1526d4 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] [instance: dc183ff4-10bd-4827-a6a8-17f6b6d739be] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:48:32.826861 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ba1c4033-4e46-4878-89b1-66005e1526d4 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:32.827352 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ba1c4033-4e46-4878-89b1-66005e1526d4 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:32.828259 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ba1c4033-4e46-4878-89b1-66005e1526d4 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:32.828906 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ba1c4033-4e46-4878-89b1-66005e1526d4 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:32.917293 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-ba1c4033-4e46-4878-89b1-66005e1526d4 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ccc2d61c7045a8abba95e7cd002a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24d5a2477eb74d5da5911b37f9031110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:32.934444 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-ba1c4033-4e46-4878-89b1-66005e1526d4 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] 10.222.0.48 "GET /compute/v2.1/servers/dc183ff4-10bd-4827-a6a8-17f6b6d739be" status: 200 len: 1271 microversion: 2.1 time: 0.123976 Jul 21 10:48:32.944462 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 129/268] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:48:32 2022] GET /compute/v2.1/servers/dc183ff4-10bd-4827-a6a8-17f6b6d739be => generated 1271 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:48:33.114713 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-1c976d65-fd66-4887-ab0b-b3591d6e15c7 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:48:33.116245 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-1c976d65-fd66-4887-ab0b-b3591d6e15c7 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:48:33.126807 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1c976d65-fd66-4887-ab0b-b3591d6e15c7 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:33.127258 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1c976d65-fd66-4887-ab0b-b3591d6e15c7 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:33.128062 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1c976d65-fd66-4887-ab0b-b3591d6e15c7 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:33.128495 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1c976d65-fd66-4887-ab0b-b3591d6e15c7 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:33.311255 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-1c976d65-fd66-4887-ab0b-b3591d6e15c7 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:33.319597 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-1c976d65-fd66-4887-ab0b-b3591d6e15c7 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:33.321144 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-1c976d65-fd66-4887-ab0b-b3591d6e15c7 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:33.322288 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-1c976d65-fd66-4887-ab0b-b3591d6e15c7 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1723 microversion: 2.20 time: 0.212493 Jul 21 10:48:33.322874 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 140/269] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:48:33 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1723 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:48:33.358611 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-63ac39ee-ddd8-4397-950d-6da753a0a735 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:48:33.358777 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-63ac39ee-ddd8-4397-950d-6da753a0a735 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: a54643be-3f53-4fe5-bab0-786b71d627bb] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:48:33.365321 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-63ac39ee-ddd8-4397-950d-6da753a0a735 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:33.365988 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-63ac39ee-ddd8-4397-950d-6da753a0a735 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:33.366913 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-63ac39ee-ddd8-4397-950d-6da753a0a735 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:33.367366 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-63ac39ee-ddd8-4397-950d-6da753a0a735 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:33.445612 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-63ac39ee-ddd8-4397-950d-6da753a0a735 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:33.454027 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-63ac39ee-ddd8-4397-950d-6da753a0a735 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb" status: 200 len: 1250 microversion: 2.1 time: 0.100258 Jul 21 10:48:33.455216 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 130/270] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:48:33 2022] GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb => generated 1250 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:48:33.955038 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-965dcce3-b783-4a37-9829-d3d922ff7203 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:48:33.955652 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-965dcce3-b783-4a37-9829-d3d922ff7203 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] [instance: dc183ff4-10bd-4827-a6a8-17f6b6d739be] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:48:33.965375 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-965dcce3-b783-4a37-9829-d3d922ff7203 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:33.966147 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-965dcce3-b783-4a37-9829-d3d922ff7203 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:33.967509 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-965dcce3-b783-4a37-9829-d3d922ff7203 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:33.968146 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-965dcce3-b783-4a37-9829-d3d922ff7203 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:34.051523 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-965dcce3-b783-4a37-9829-d3d922ff7203 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ccc2d61c7045a8abba95e7cd002a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24d5a2477eb74d5da5911b37f9031110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:34.059331 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-965dcce3-b783-4a37-9829-d3d922ff7203 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] 10.222.0.48 "GET /compute/v2.1/servers/dc183ff4-10bd-4827-a6a8-17f6b6d739be" status: 200 len: 1277 microversion: 2.1 time: 0.108152 Jul 21 10:48:34.059916 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 141/271] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:48:33 2022] GET /compute/v2.1/servers/dc183ff4-10bd-4827-a6a8-17f6b6d739be => generated 1277 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:48:34.340954 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-417d8f17-69dd-4873-86ef-c313ad9c0dfa tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:48:34.341564 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-417d8f17-69dd-4873-86ef-c313ad9c0dfa tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:48:34.348496 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-417d8f17-69dd-4873-86ef-c313ad9c0dfa tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:34.348949 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-417d8f17-69dd-4873-86ef-c313ad9c0dfa tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:34.349719 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-417d8f17-69dd-4873-86ef-c313ad9c0dfa tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:34.350149 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-417d8f17-69dd-4873-86ef-c313ad9c0dfa tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:34.472649 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-87498f3d-7247-4985-a4e8-4da21317b7b6 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:48:34.473283 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-87498f3d-7247-4985-a4e8-4da21317b7b6 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: a54643be-3f53-4fe5-bab0-786b71d627bb] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:48:34.508142 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-87498f3d-7247-4985-a4e8-4da21317b7b6 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:34.509996 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-87498f3d-7247-4985-a4e8-4da21317b7b6 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:34.510865 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-87498f3d-7247-4985-a4e8-4da21317b7b6 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:34.513448 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-87498f3d-7247-4985-a4e8-4da21317b7b6 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:34.616745 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-87498f3d-7247-4985-a4e8-4da21317b7b6 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:34.635237 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-87498f3d-7247-4985-a4e8-4da21317b7b6 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb" status: 200 len: 1306 microversion: 2.1 time: 0.167338 Jul 21 10:48:34.635833 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 142/272] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:48:34 2022] GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb => generated 1306 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:48:34.641253 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-417d8f17-69dd-4873-86ef-c313ad9c0dfa tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:34.652552 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-417d8f17-69dd-4873-86ef-c313ad9c0dfa tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:34.654206 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-417d8f17-69dd-4873-86ef-c313ad9c0dfa tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:34.655402 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-417d8f17-69dd-4873-86ef-c313ad9c0dfa tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1723 microversion: 2.20 time: 0.318449 Jul 21 10:48:34.660296 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 131/273] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:48:34 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1723 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 10:48:35.076684 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-4cf9614b-9e2a-41f1-a79a-8d3865326019 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:48:35.077654 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-4cf9614b-9e2a-41f1-a79a-8d3865326019 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] [instance: dc183ff4-10bd-4827-a6a8-17f6b6d739be] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:48:35.085187 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4cf9614b-9e2a-41f1-a79a-8d3865326019 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:35.085187 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4cf9614b-9e2a-41f1-a79a-8d3865326019 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:35.085187 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4cf9614b-9e2a-41f1-a79a-8d3865326019 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:35.085572 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4cf9614b-9e2a-41f1-a79a-8d3865326019 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:35.226346 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-4cf9614b-9e2a-41f1-a79a-8d3865326019 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ccc2d61c7045a8abba95e7cd002a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24d5a2477eb74d5da5911b37f9031110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:35.238754 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-4cf9614b-9e2a-41f1-a79a-8d3865326019 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] 10.222.0.48 "GET /compute/v2.1/servers/dc183ff4-10bd-4827-a6a8-17f6b6d739be" status: 200 len: 1319 microversion: 2.1 time: 0.165956 Jul 21 10:48:35.239342 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 143/274] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:48:35 2022] GET /compute/v2.1/servers/dc183ff4-10bd-4827-a6a8-17f6b6d739be => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:48:35.656345 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-ee176d16-96b7-499d-929b-502ff9924910 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:48:35.658038 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-ee176d16-96b7-499d-929b-502ff9924910 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: a54643be-3f53-4fe5-bab0-786b71d627bb] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:48:35.667757 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ee176d16-96b7-499d-929b-502ff9924910 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:35.668538 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ee176d16-96b7-499d-929b-502ff9924910 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:35.669789 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ee176d16-96b7-499d-929b-502ff9924910 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:35.670431 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ee176d16-96b7-499d-929b-502ff9924910 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:35.674113 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-60506e53-1a1c-474f-8b38-6002e6fc3eb9 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:48:35.674744 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-60506e53-1a1c-474f-8b38-6002e6fc3eb9 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:48:35.692522 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-60506e53-1a1c-474f-8b38-6002e6fc3eb9 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:35.695007 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-60506e53-1a1c-474f-8b38-6002e6fc3eb9 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:35.695007 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-60506e53-1a1c-474f-8b38-6002e6fc3eb9 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:35.695007 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-60506e53-1a1c-474f-8b38-6002e6fc3eb9 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:35.756213 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-ee176d16-96b7-499d-929b-502ff9924910 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:35.767524 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-ee176d16-96b7-499d-929b-502ff9924910 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb" status: 200 len: 1304 microversion: 2.1 time: 0.117892 Jul 21 10:48:35.770144 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 132/275] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:48:35 2022] GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb => generated 1304 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:48:35.774966 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [req-a348fd82-b930-4b4c-91fd-314e78b58c4b req-9b48f6e7-1821-4598-8e42-bec608e35aef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc183ff4-10bd-4827-a6a8-17f6b6d739be", "tag": "87f2bea1-63ad-4eba-8841-1dd79129258c"}]} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:48:35.802667 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-a348fd82-b930-4b4c-91fd-314e78b58c4b req-9b48f6e7-1821-4598-8e42-bec608e35aef service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:35.803508 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-a348fd82-b930-4b4c-91fd-314e78b58c4b req-9b48f6e7-1821-4598-8e42-bec608e35aef service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:35.820802 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.compute.server_external_events [req-a348fd82-b930-4b4c-91fd-314e78b58c4b req-9b48f6e7-1821-4598-8e42-bec608e35aef service nova] Creating event network-changed:87f2bea1-63ad-4eba-8841-1dd79129258c for instance dc183ff4-10bd-4827-a6a8-17f6b6d739be on hv-cinder-84980 Jul 21 10:48:35.831014 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [req-a348fd82-b930-4b4c-91fd-314e78b58c4b req-9b48f6e7-1821-4598-8e42-bec608e35aef service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055196 Jul 21 10:48:35.831602 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 133/276] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 21 10:48:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:48:36.191576 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-60506e53-1a1c-474f-8b38-6002e6fc3eb9 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:36.211206 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-60506e53-1a1c-474f-8b38-6002e6fc3eb9 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:36.213005 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-60506e53-1a1c-474f-8b38-6002e6fc3eb9 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:36.215407 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-60506e53-1a1c-474f-8b38-6002e6fc3eb9 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1723 microversion: 2.20 time: 0.544206 Jul 21 10:48:36.216564 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 144/277] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:48:35 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1723 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 10:48:36.257675 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-e49b7159-7c0c-4eeb-be3a-e5e937abb125 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:48:36.259340 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-e49b7159-7c0c-4eeb-be3a-e5e937abb125 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] [instance: dc183ff4-10bd-4827-a6a8-17f6b6d739be] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:48:36.269176 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e49b7159-7c0c-4eeb-be3a-e5e937abb125 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:36.269899 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e49b7159-7c0c-4eeb-be3a-e5e937abb125 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:36.271545 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e49b7159-7c0c-4eeb-be3a-e5e937abb125 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:36.272101 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e49b7159-7c0c-4eeb-be3a-e5e937abb125 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:36.411616 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-3d7f8403-fb77-4b6b-b51f-6d5e6feb466e tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:48:36.412365 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-3d7f8403-fb77-4b6b-b51f-6d5e6feb466e tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 691ae8fc-92e7-4940-99d8-7edb5a96d2f3] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:48:36.430977 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3d7f8403-fb77-4b6b-b51f-6d5e6feb466e tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:36.432175 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3d7f8403-fb77-4b6b-b51f-6d5e6feb466e tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:36.433661 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3d7f8403-fb77-4b6b-b51f-6d5e6feb466e tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:36.434314 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3d7f8403-fb77-4b6b-b51f-6d5e6feb466e tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:36.444276 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-e49b7159-7c0c-4eeb-be3a-e5e937abb125 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ccc2d61c7045a8abba95e7cd002a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24d5a2477eb74d5da5911b37f9031110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:36.447123 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:48:36.456340 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-e49b7159-7c0c-4eeb-be3a-e5e937abb125 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] 10.222.0.48 "GET /compute/v2.1/servers/dc183ff4-10bd-4827-a6a8-17f6b6d739be" status: 200 len: 1319 microversion: 2.1 time: 0.204247 Jul 21 10:48:36.457979 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 134/278] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:48:36 2022] GET /compute/v2.1/servers/dc183ff4-10bd-4827-a6a8-17f6b6d739be => generated 1319 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:48:36.481997 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-3d7f8403-fb77-4b6b-b51f-6d5e6feb466e tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/691ae8fc-92e7-4940-99d8-7edb5a96d2f3/ips" status: 200 len: 150 microversion: 2.1 time: 0.075137 Jul 21 10:48:36.482989 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 145/279] 10.222.0.48 () {58 vars in 1247 bytes} [Thu Jul 21 10:48:36 2022] GET /compute/v2.1/servers/691ae8fc-92e7-4940-99d8-7edb5a96d2f3/ips => generated 150 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 10:48:36.790072 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-fe44f394-6027-4247-878a-3a96d95b27bf tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:48:36.790072 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-fe44f394-6027-4247-878a-3a96d95b27bf tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: a54643be-3f53-4fe5-bab0-786b71d627bb] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:48:36.796632 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fe44f394-6027-4247-878a-3a96d95b27bf tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:36.797287 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fe44f394-6027-4247-878a-3a96d95b27bf tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:36.798167 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fe44f394-6027-4247-878a-3a96d95b27bf tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:36.798697 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fe44f394-6027-4247-878a-3a96d95b27bf tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:36.971847 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-fe44f394-6027-4247-878a-3a96d95b27bf tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:36.985110 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-fe44f394-6027-4247-878a-3a96d95b27bf tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb" status: 200 len: 1372 microversion: 2.1 time: 0.201066 Jul 21 10:48:36.993536 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 135/280] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:48:36 2022] GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb => generated 1372 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:48:37.234428 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-fba737a4-ade1-4297-9dec-e885d89596ba tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:48:37.235056 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-fba737a4-ade1-4297-9dec-e885d89596ba tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:48:37.241432 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-fba737a4-ade1-4297-9dec-e885d89596ba tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:37.241888 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-fba737a4-ade1-4297-9dec-e885d89596ba tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:37.242675 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-fba737a4-ade1-4297-9dec-e885d89596ba tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:37.243229 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-fba737a4-ade1-4297-9dec-e885d89596ba tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:37.418126 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-fba737a4-ade1-4297-9dec-e885d89596ba tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:37.458667 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-fba737a4-ade1-4297-9dec-e885d89596ba tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:37.458667 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-fba737a4-ade1-4297-9dec-e885d89596ba tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:37.458667 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-fba737a4-ade1-4297-9dec-e885d89596ba tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1723 microversion: 2.20 time: 0.228079 Jul 21 10:48:37.472625 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 146/281] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:48:37 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1723 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:48:37.484393 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-694667b8-4833-4d1e-8f0b-5c9b5b5e9127 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:48:37.485025 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-694667b8-4833-4d1e-8f0b-5c9b5b5e9127 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] [instance: dc183ff4-10bd-4827-a6a8-17f6b6d739be] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:48:37.513411 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-694667b8-4833-4d1e-8f0b-5c9b5b5e9127 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:37.513928 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-694667b8-4833-4d1e-8f0b-5c9b5b5e9127 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:37.514745 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-694667b8-4833-4d1e-8f0b-5c9b5b5e9127 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:37.515186 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-694667b8-4833-4d1e-8f0b-5c9b5b5e9127 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:37.765968 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-694667b8-4833-4d1e-8f0b-5c9b5b5e9127 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ccc2d61c7045a8abba95e7cd002a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24d5a2477eb74d5da5911b37f9031110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:37.773479 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-694667b8-4833-4d1e-8f0b-5c9b5b5e9127 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] 10.222.0.48 "GET /compute/v2.1/servers/dc183ff4-10bd-4827-a6a8-17f6b6d739be" status: 200 len: 1319 microversion: 2.1 time: 0.301816 Jul 21 10:48:37.774039 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 136/282] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:48:37 2022] GET /compute/v2.1/servers/dc183ff4-10bd-4827-a6a8-17f6b6d739be => generated 1319 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:48:37.897557 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [req-f7b19511-30bc-42ed-96f0-a19e2beca811 req-77c9b31c-e11f-4928-81cc-4345c7f44d1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a54643be-3f53-4fe5-bab0-786b71d627bb", "tag": "6ac84834-b64c-48e6-a97a-aed57229fe41"}]} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:48:37.906029 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-f7b19511-30bc-42ed-96f0-a19e2beca811 req-77c9b31c-e11f-4928-81cc-4345c7f44d1f service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:37.906888 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-f7b19511-30bc-42ed-96f0-a19e2beca811 req-77c9b31c-e11f-4928-81cc-4345c7f44d1f service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:37.918457 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.compute.server_external_events [req-f7b19511-30bc-42ed-96f0-a19e2beca811 req-77c9b31c-e11f-4928-81cc-4345c7f44d1f service nova] Creating event network-changed:6ac84834-b64c-48e6-a97a-aed57229fe41 for instance a54643be-3f53-4fe5-bab0-786b71d627bb on hv-cinder-84980 Jul 21 10:48:37.923556 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [req-f7b19511-30bc-42ed-96f0-a19e2beca811 req-77c9b31c-e11f-4928-81cc-4345c7f44d1f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029527 Jul 21 10:48:37.924465 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 147/283] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 21 10:48:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:48:38.009703 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-aca6cdde-48a1-43d2-a15b-a59092189d3c tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:48:38.010483 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-aca6cdde-48a1-43d2-a15b-a59092189d3c tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: a54643be-3f53-4fe5-bab0-786b71d627bb] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:48:38.017979 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-aca6cdde-48a1-43d2-a15b-a59092189d3c tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:38.018513 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-aca6cdde-48a1-43d2-a15b-a59092189d3c tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:38.019535 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-aca6cdde-48a1-43d2-a15b-a59092189d3c tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:38.019943 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-aca6cdde-48a1-43d2-a15b-a59092189d3c tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:38.152472 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-aca6cdde-48a1-43d2-a15b-a59092189d3c tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:38.159845 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-aca6cdde-48a1-43d2-a15b-a59092189d3c tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb" status: 200 len: 1372 microversion: 2.1 time: 0.154160 Jul 21 10:48:38.160499 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 137/284] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:48:38 2022] GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb => generated 1372 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:48:38.492831 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-d7cbd93d-5474-4319-91cb-4a97832af688 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:48:38.493520 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-d7cbd93d-5474-4319-91cb-4a97832af688 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:48:38.500290 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d7cbd93d-5474-4319-91cb-4a97832af688 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:38.500732 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d7cbd93d-5474-4319-91cb-4a97832af688 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:38.501476 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d7cbd93d-5474-4319-91cb-4a97832af688 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:38.501900 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d7cbd93d-5474-4319-91cb-4a97832af688 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:38.647148 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-d7cbd93d-5474-4319-91cb-4a97832af688 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:38.656877 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-d7cbd93d-5474-4319-91cb-4a97832af688 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:38.658777 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-d7cbd93d-5474-4319-91cb-4a97832af688 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:38.659926 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-d7cbd93d-5474-4319-91cb-4a97832af688 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1723 microversion: 2.20 time: 0.171911 Jul 21 10:48:38.660662 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 148/285] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:48:38 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:48:38.790658 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-0d1ca997-9340-4fd7-b254-976c5a8785b7 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:48:38.791187 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-0d1ca997-9340-4fd7-b254-976c5a8785b7 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] [instance: dc183ff4-10bd-4827-a6a8-17f6b6d739be] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:48:38.797898 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0d1ca997-9340-4fd7-b254-976c5a8785b7 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:38.798344 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0d1ca997-9340-4fd7-b254-976c5a8785b7 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:38.799130 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0d1ca997-9340-4fd7-b254-976c5a8785b7 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:38.799559 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0d1ca997-9340-4fd7-b254-976c5a8785b7 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:38.945661 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-0d1ca997-9340-4fd7-b254-976c5a8785b7 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ccc2d61c7045a8abba95e7cd002a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24d5a2477eb74d5da5911b37f9031110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:38.954133 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-0d1ca997-9340-4fd7-b254-976c5a8785b7 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] 10.222.0.48 "GET /compute/v2.1/servers/dc183ff4-10bd-4827-a6a8-17f6b6d739be" status: 200 len: 1319 microversion: 2.1 time: 0.167350 Jul 21 10:48:38.954983 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 138/286] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:48:38 2022] GET /compute/v2.1/servers/dc183ff4-10bd-4827-a6a8-17f6b6d739be => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:48:39.177622 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-cc55c0df-a807-4a45-a1ce-8c242d9277d3 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:48:39.178614 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-cc55c0df-a807-4a45-a1ce-8c242d9277d3 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: a54643be-3f53-4fe5-bab0-786b71d627bb] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:48:39.203904 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-cc55c0df-a807-4a45-a1ce-8c242d9277d3 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:39.205402 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-cc55c0df-a807-4a45-a1ce-8c242d9277d3 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:39.206408 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-cc55c0df-a807-4a45-a1ce-8c242d9277d3 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:39.206875 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-cc55c0df-a807-4a45-a1ce-8c242d9277d3 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:39.371675 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell1:SELECT=100 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:48:39.500054 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-cc55c0df-a807-4a45-a1ce-8c242d9277d3 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:39.507511 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-cc55c0df-a807-4a45-a1ce-8c242d9277d3 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb" status: 200 len: 1372 microversion: 2.1 time: 0.334016 Jul 21 10:48:39.508067 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 149/287] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:48:39 2022] GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb => generated 1372 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:48:39.681319 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-3a5a1d19-8d9e-483e-80b1-6799d5842c26 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:48:39.681917 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-3a5a1d19-8d9e-483e-80b1-6799d5842c26 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:48:39.688289 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3a5a1d19-8d9e-483e-80b1-6799d5842c26 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:39.688739 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3a5a1d19-8d9e-483e-80b1-6799d5842c26 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:39.689512 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3a5a1d19-8d9e-483e-80b1-6799d5842c26 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:39.689946 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3a5a1d19-8d9e-483e-80b1-6799d5842c26 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:39.715402 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-f08b0ecf-e24b-4336-a0a1-01f399ce718e tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5314c7de-a97a-4a8b-adc5-7761fd65219f"}} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:48:39.716545 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-f08b0ecf-e24b-4336-a0a1-01f399ce718e tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 691ae8fc-92e7-4940-99d8-7edb5a96d2f3] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:48:39.722963 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f08b0ecf-e24b-4336-a0a1-01f399ce718e tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:39.723415 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f08b0ecf-e24b-4336-a0a1-01f399ce718e tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:39.724186 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f08b0ecf-e24b-4336-a0a1-01f399ce718e tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:39.724624 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f08b0ecf-e24b-4336-a0a1-01f399ce718e tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:39.837345 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-3a5a1d19-8d9e-483e-80b1-6799d5842c26 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:39.846272 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-3a5a1d19-8d9e-483e-80b1-6799d5842c26 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:39.847849 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-3a5a1d19-8d9e-483e-80b1-6799d5842c26 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:39.848983 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-3a5a1d19-8d9e-483e-80b1-6799d5842c26 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1723 microversion: 2.20 time: 0.172205 Jul 21 10:48:39.849535 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 139/288] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:48:39 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:48:39.971335 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-fa6c3744-fcf4-416f-9b2e-a1efcec18f2a tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:48:39.971940 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-fa6c3744-fcf4-416f-9b2e-a1efcec18f2a tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] [instance: dc183ff4-10bd-4827-a6a8-17f6b6d739be] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:48:39.977897 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fa6c3744-fcf4-416f-9b2e-a1efcec18f2a tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:39.978337 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fa6c3744-fcf4-416f-9b2e-a1efcec18f2a tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:39.979130 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fa6c3744-fcf4-416f-9b2e-a1efcec18f2a tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:39.979564 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fa6c3744-fcf4-416f-9b2e-a1efcec18f2a tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:40.118232 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-fa6c3744-fcf4-416f-9b2e-a1efcec18f2a tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ccc2d61c7045a8abba95e7cd002a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24d5a2477eb74d5da5911b37f9031110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:40.125822 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-fa6c3744-fcf4-416f-9b2e-a1efcec18f2a tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] 10.222.0.48 "GET /compute/v2.1/servers/dc183ff4-10bd-4827-a6a8-17f6b6d739be" status: 200 len: 1319 microversion: 2.1 time: 0.158673 Jul 21 10:48:40.126393 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 140/289] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:48:39 2022] GET /compute/v2.1/servers/dc183ff4-10bd-4827-a6a8-17f6b6d739be => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:48:40.524960 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-f903afe1-baf0-49aa-b138-36f0e78547b3 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:48:40.525595 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-f903afe1-baf0-49aa-b138-36f0e78547b3 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: a54643be-3f53-4fe5-bab0-786b71d627bb] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:48:40.532692 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f903afe1-baf0-49aa-b138-36f0e78547b3 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:40.533280 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f903afe1-baf0-49aa-b138-36f0e78547b3 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:40.534046 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f903afe1-baf0-49aa-b138-36f0e78547b3 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:40.534474 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f903afe1-baf0-49aa-b138-36f0e78547b3 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:40.671783 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-f903afe1-baf0-49aa-b138-36f0e78547b3 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:40.679207 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-f903afe1-baf0-49aa-b138-36f0e78547b3 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb" status: 200 len: 1372 microversion: 2.1 time: 0.158127 Jul 21 10:48:40.679865 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 141/290] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:48:40 2022] GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb => generated 1372 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:48:40.868205 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-83e98df1-21ca-4052-baa0-09de29b043c8 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:48:40.868865 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-83e98df1-21ca-4052-baa0-09de29b043c8 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:48:40.876830 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-83e98df1-21ca-4052-baa0-09de29b043c8 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:40.877332 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-83e98df1-21ca-4052-baa0-09de29b043c8 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:40.878096 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-83e98df1-21ca-4052-baa0-09de29b043c8 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:40.878524 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-83e98df1-21ca-4052-baa0-09de29b043c8 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:41.057984 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-83e98df1-21ca-4052-baa0-09de29b043c8 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:41.070774 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-83e98df1-21ca-4052-baa0-09de29b043c8 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:41.072312 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-83e98df1-21ca-4052-baa0-09de29b043c8 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:41.073469 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-83e98df1-21ca-4052-baa0-09de29b043c8 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1723 microversion: 2.20 time: 0.209165 Jul 21 10:48:41.074191 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 142/291] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:48:40 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1723 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 10:48:41.143687 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-a9e850f5-8a48-42b3-a0e4-d93bd9fd5ea3 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:48:41.144291 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-a9e850f5-8a48-42b3-a0e4-d93bd9fd5ea3 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] [instance: dc183ff4-10bd-4827-a6a8-17f6b6d739be] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:48:41.150349 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a9e850f5-8a48-42b3-a0e4-d93bd9fd5ea3 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:41.150816 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a9e850f5-8a48-42b3-a0e4-d93bd9fd5ea3 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:41.151586 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a9e850f5-8a48-42b3-a0e4-d93bd9fd5ea3 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:41.152576 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a9e850f5-8a48-42b3-a0e4-d93bd9fd5ea3 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:41.326133 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-a9e850f5-8a48-42b3-a0e4-d93bd9fd5ea3 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ccc2d61c7045a8abba95e7cd002a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24d5a2477eb74d5da5911b37f9031110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:41.338058 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-a9e850f5-8a48-42b3-a0e4-d93bd9fd5ea3 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] 10.222.0.48 "GET /compute/v2.1/servers/dc183ff4-10bd-4827-a6a8-17f6b6d739be" status: 200 len: 1319 microversion: 2.1 time: 0.198147 Jul 21 10:48:41.341651 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 143/292] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:48:41 2022] GET /compute/v2.1/servers/dc183ff4-10bd-4827-a6a8-17f6b6d739be => generated 1319 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:48:41.696596 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-eea0ede8-0523-4809-bb24-e3fac4e9dee5 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:48:41.697359 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-eea0ede8-0523-4809-bb24-e3fac4e9dee5 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: a54643be-3f53-4fe5-bab0-786b71d627bb] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:48:41.704962 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-eea0ede8-0523-4809-bb24-e3fac4e9dee5 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:41.705484 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-eea0ede8-0523-4809-bb24-e3fac4e9dee5 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:41.706378 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-eea0ede8-0523-4809-bb24-e3fac4e9dee5 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:41.706915 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-eea0ede8-0523-4809-bb24-e3fac4e9dee5 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:41.849015 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-eea0ede8-0523-4809-bb24-e3fac4e9dee5 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:41.857283 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-eea0ede8-0523-4809-bb24-e3fac4e9dee5 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb" status: 200 len: 1372 microversion: 2.1 time: 0.164464 Jul 21 10:48:41.857941 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 144/293] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:48:41 2022] GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb => generated 1372 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:48:42.092476 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-e39e622a-a513-4291-a46f-c7dfd1a36c20 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:48:42.093162 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-e39e622a-a513-4291-a46f-c7dfd1a36c20 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:48:42.095190 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell0:SELECT=4 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:48:42.095851 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell0:SELECT=14 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:48:42.100582 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e39e622a-a513-4291-a46f-c7dfd1a36c20 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:42.101022 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e39e622a-a513-4291-a46f-c7dfd1a36c20 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:42.101773 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e39e622a-a513-4291-a46f-c7dfd1a36c20 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:42.102206 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e39e622a-a513-4291-a46f-c7dfd1a36c20 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:42.279032 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-e39e622a-a513-4291-a46f-c7dfd1a36c20 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:42.287122 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-e39e622a-a513-4291-a46f-c7dfd1a36c20 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:42.288628 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-e39e622a-a513-4291-a46f-c7dfd1a36c20 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:42.289829 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-e39e622a-a513-4291-a46f-c7dfd1a36c20 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1723 microversion: 2.20 time: 0.202080 Jul 21 10:48:42.290389 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 145/294] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:48:42 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1723 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 10:48:42.336261 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell0:SELECT=8 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:48:42.357117 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-5d10cda0-c549-413e-8961-8c9f138e91d9 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:48:42.357725 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-5d10cda0-c549-413e-8961-8c9f138e91d9 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] [instance: dc183ff4-10bd-4827-a6a8-17f6b6d739be] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:48:42.364303 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5d10cda0-c549-413e-8961-8c9f138e91d9 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:42.364749 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5d10cda0-c549-413e-8961-8c9f138e91d9 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:42.365504 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5d10cda0-c549-413e-8961-8c9f138e91d9 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:42.365939 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5d10cda0-c549-413e-8961-8c9f138e91d9 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:42.544423 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-5d10cda0-c549-413e-8961-8c9f138e91d9 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ccc2d61c7045a8abba95e7cd002a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24d5a2477eb74d5da5911b37f9031110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:42.552153 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-5d10cda0-c549-413e-8961-8c9f138e91d9 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] 10.222.0.48 "GET /compute/v2.1/servers/dc183ff4-10bd-4827-a6a8-17f6b6d739be" status: 200 len: 1319 microversion: 2.1 time: 0.199066 Jul 21 10:48:42.552728 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 146/295] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:48:42 2022] GET /compute/v2.1/servers/dc183ff4-10bd-4827-a6a8-17f6b6d739be => generated 1319 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:48:42.874081 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-342f0875-29f0-4c87-9673-50930ed2a29b tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:48:42.874752 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-342f0875-29f0-4c87-9673-50930ed2a29b tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: a54643be-3f53-4fe5-bab0-786b71d627bb] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:48:42.883547 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-342f0875-29f0-4c87-9673-50930ed2a29b tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:42.883999 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-342f0875-29f0-4c87-9673-50930ed2a29b tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:42.884835 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-342f0875-29f0-4c87-9673-50930ed2a29b tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:42.885269 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-342f0875-29f0-4c87-9673-50930ed2a29b tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:43.027371 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-342f0875-29f0-4c87-9673-50930ed2a29b tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:43.034946 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-342f0875-29f0-4c87-9673-50930ed2a29b tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb" status: 200 len: 1372 microversion: 2.1 time: 0.164835 Jul 21 10:48:43.035507 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 147/296] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:48:42 2022] GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb => generated 1372 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:48:43.307747 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-5f7d34ab-1db1-4831-a55f-a02b51e6f8fa tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:48:43.309026 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-5f7d34ab-1db1-4831-a55f-a02b51e6f8fa tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:48:43.315390 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5f7d34ab-1db1-4831-a55f-a02b51e6f8fa tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:43.315832 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5f7d34ab-1db1-4831-a55f-a02b51e6f8fa tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:43.316600 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5f7d34ab-1db1-4831-a55f-a02b51e6f8fa tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:43.319484 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5f7d34ab-1db1-4831-a55f-a02b51e6f8fa tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:43.457012 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-5f7d34ab-1db1-4831-a55f-a02b51e6f8fa tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:43.466312 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-5f7d34ab-1db1-4831-a55f-a02b51e6f8fa tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:43.468492 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-5f7d34ab-1db1-4831-a55f-a02b51e6f8fa tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:43.469968 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-5f7d34ab-1db1-4831-a55f-a02b51e6f8fa tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1723 microversion: 2.20 time: 0.165983 Jul 21 10:48:43.470871 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 148/297] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:48:43 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:48:43.571292 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-fda2fb2a-e48d-46d6-98bd-bf82f6680640 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:48:43.572015 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-fda2fb2a-e48d-46d6-98bd-bf82f6680640 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] [instance: dc183ff4-10bd-4827-a6a8-17f6b6d739be] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:48:43.579967 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fda2fb2a-e48d-46d6-98bd-bf82f6680640 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:43.580433 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fda2fb2a-e48d-46d6-98bd-bf82f6680640 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:43.581349 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fda2fb2a-e48d-46d6-98bd-bf82f6680640 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:43.581748 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fda2fb2a-e48d-46d6-98bd-bf82f6680640 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:43.752286 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-fda2fb2a-e48d-46d6-98bd-bf82f6680640 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ccc2d61c7045a8abba95e7cd002a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24d5a2477eb74d5da5911b37f9031110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:43.761288 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-fda2fb2a-e48d-46d6-98bd-bf82f6680640 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] 10.222.0.48 "GET /compute/v2.1/servers/dc183ff4-10bd-4827-a6a8-17f6b6d739be" status: 200 len: 1319 microversion: 2.1 time: 0.193471 Jul 21 10:48:43.762154 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 149/298] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:48:43 2022] GET /compute/v2.1/servers/dc183ff4-10bd-4827-a6a8-17f6b6d739be => generated 1319 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:48:43.768188 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [req-f617f8df-e54a-4edb-9eb8-2a86be845f59 req-e6433f7b-a579-41b4-bcaa-c981f9951769 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc183ff4-10bd-4827-a6a8-17f6b6d739be", "name": "network-vif-plugged", "status": "completed", "tag": "87f2bea1-63ad-4eba-8841-1dd79129258c"}]} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:48:43.788154 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-f617f8df-e54a-4edb-9eb8-2a86be845f59 req-e6433f7b-a579-41b4-bcaa-c981f9951769 service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:43.788816 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-f617f8df-e54a-4edb-9eb8-2a86be845f59 req-e6433f7b-a579-41b4-bcaa-c981f9951769 service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:43.802388 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.compute.server_external_events [req-f617f8df-e54a-4edb-9eb8-2a86be845f59 req-e6433f7b-a579-41b4-bcaa-c981f9951769 service nova] Creating event network-vif-plugged:87f2bea1-63ad-4eba-8841-1dd79129258c for instance dc183ff4-10bd-4827-a6a8-17f6b6d739be on hv-cinder-84980 Jul 21 10:48:43.808342 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [req-f617f8df-e54a-4edb-9eb8-2a86be845f59 req-e6433f7b-a579-41b4-bcaa-c981f9951769 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044366 Jul 21 10:48:43.808809 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 150/299] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 21 10:48:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:48:44.053600 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-fc74321f-d8f1-481d-b860-1a804b7475ed tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:48:44.054404 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-fc74321f-d8f1-481d-b860-1a804b7475ed tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: a54643be-3f53-4fe5-bab0-786b71d627bb] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:48:44.062388 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fc74321f-d8f1-481d-b860-1a804b7475ed tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:44.062980 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fc74321f-d8f1-481d-b860-1a804b7475ed tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:44.063836 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fc74321f-d8f1-481d-b860-1a804b7475ed tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:44.064320 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fc74321f-d8f1-481d-b860-1a804b7475ed tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:44.207382 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-fc74321f-d8f1-481d-b860-1a804b7475ed tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:44.215525 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-fc74321f-d8f1-481d-b860-1a804b7475ed tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb" status: 200 len: 1372 microversion: 2.1 time: 0.166241 Jul 21 10:48:44.216086 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 151/300] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:48:44 2022] GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb => generated 1372 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:48:44.475056 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-f08b0ecf-e24b-4336-a0a1-01f399ce718e tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "POST /compute/v2.1/servers/691ae8fc-92e7-4940-99d8-7edb5a96d2f3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.764371 Jul 21 10:48:44.475712 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 150/301] 10.222.0.48 () {60 vars in 1322 bytes} [Thu Jul 21 10:48:39 2022] POST /compute/v2.1/servers/691ae8fc-92e7-4940-99d8-7edb5a96d2f3/os-volume_attachments => generated 194 bytes in 4766 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 10:48:44.489109 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-be0e4f8c-05ee-4810-bab6-f6868fd14555 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:48:44.489716 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-be0e4f8c-05ee-4810-bab6-f6868fd14555 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:48:44.496387 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-be0e4f8c-05ee-4810-bab6-f6868fd14555 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:44.496854 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-be0e4f8c-05ee-4810-bab6-f6868fd14555 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:44.497607 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-be0e4f8c-05ee-4810-bab6-f6868fd14555 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:44.498037 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-be0e4f8c-05ee-4810-bab6-f6868fd14555 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:44.500921 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell1:SELECT=100 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:48:44.652736 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-be0e4f8c-05ee-4810-bab6-f6868fd14555 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:44.661081 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-be0e4f8c-05ee-4810-bab6-f6868fd14555 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:44.662585 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-be0e4f8c-05ee-4810-bab6-f6868fd14555 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:44.674730 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-be0e4f8c-05ee-4810-bab6-f6868fd14555 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1723 microversion: 2.20 time: 0.178539 Jul 21 10:48:44.674730 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 152/302] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:48:44 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:48:44.782979 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-f6d89bfa-1a9d-4d52-8ad8-6c7e7b01d5d8 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:48:44.783677 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-f6d89bfa-1a9d-4d52-8ad8-6c7e7b01d5d8 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] [instance: dc183ff4-10bd-4827-a6a8-17f6b6d739be] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:48:44.791257 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f6d89bfa-1a9d-4d52-8ad8-6c7e7b01d5d8 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:44.791699 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f6d89bfa-1a9d-4d52-8ad8-6c7e7b01d5d8 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:44.793248 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f6d89bfa-1a9d-4d52-8ad8-6c7e7b01d5d8 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:44.793933 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f6d89bfa-1a9d-4d52-8ad8-6c7e7b01d5d8 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:44.946224 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-f6d89bfa-1a9d-4d52-8ad8-6c7e7b01d5d8 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ccc2d61c7045a8abba95e7cd002a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24d5a2477eb74d5da5911b37f9031110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:44.955293 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-f6d89bfa-1a9d-4d52-8ad8-6c7e7b01d5d8 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] 10.222.0.48 "GET /compute/v2.1/servers/dc183ff4-10bd-4827-a6a8-17f6b6d739be" status: 200 len: 1319 microversion: 2.1 time: 0.176402 Jul 21 10:48:44.955862 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 151/303] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:48:44 2022] GET /compute/v2.1/servers/dc183ff4-10bd-4827-a6a8-17f6b6d739be => generated 1319 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:48:45.233420 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-7c1928f9-9357-437f-9f59-6526702b7be2 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:48:45.234269 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-7c1928f9-9357-437f-9f59-6526702b7be2 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: a54643be-3f53-4fe5-bab0-786b71d627bb] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:48:45.241457 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7c1928f9-9357-437f-9f59-6526702b7be2 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:45.242152 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7c1928f9-9357-437f-9f59-6526702b7be2 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:45.242968 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7c1928f9-9357-437f-9f59-6526702b7be2 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:45.243568 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7c1928f9-9357-437f-9f59-6526702b7be2 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:45.382521 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-7c1928f9-9357-437f-9f59-6526702b7be2 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:45.391586 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-7c1928f9-9357-437f-9f59-6526702b7be2 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb" status: 200 len: 1372 microversion: 2.1 time: 0.162083 Jul 21 10:48:45.392307 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 153/304] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:48:45 2022] GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb => generated 1372 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:48:45.685007 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-430adf4d-91b1-40b3-b5f4-a83b9bb4f39f tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:48:45.685657 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-430adf4d-91b1-40b3-b5f4-a83b9bb4f39f tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:48:45.691597 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-430adf4d-91b1-40b3-b5f4-a83b9bb4f39f tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:45.692042 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-430adf4d-91b1-40b3-b5f4-a83b9bb4f39f tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:45.692800 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-430adf4d-91b1-40b3-b5f4-a83b9bb4f39f tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:45.693229 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-430adf4d-91b1-40b3-b5f4-a83b9bb4f39f tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:45.836570 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-430adf4d-91b1-40b3-b5f4-a83b9bb4f39f tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:45.845963 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-430adf4d-91b1-40b3-b5f4-a83b9bb4f39f tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:45.847553 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-430adf4d-91b1-40b3-b5f4-a83b9bb4f39f tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:45.848915 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-430adf4d-91b1-40b3-b5f4-a83b9bb4f39f tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1723 microversion: 2.20 time: 0.168330 Jul 21 10:48:45.849499 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 152/305] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:48:45 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:48:45.973696 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-ca707af0-ec04-4b05-9848-398ea285e163 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:48:45.974343 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-ca707af0-ec04-4b05-9848-398ea285e163 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] [instance: dc183ff4-10bd-4827-a6a8-17f6b6d739be] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:48:45.980639 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ca707af0-ec04-4b05-9848-398ea285e163 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:45.981090 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ca707af0-ec04-4b05-9848-398ea285e163 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:45.981854 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ca707af0-ec04-4b05-9848-398ea285e163 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:45.982379 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ca707af0-ec04-4b05-9848-398ea285e163 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:46.119758 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-ca707af0-ec04-4b05-9848-398ea285e163 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ccc2d61c7045a8abba95e7cd002a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24d5a2477eb74d5da5911b37f9031110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:46.127880 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-ca707af0-ec04-4b05-9848-398ea285e163 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] 10.222.0.48 "GET /compute/v2.1/servers/dc183ff4-10bd-4827-a6a8-17f6b6d739be" status: 200 len: 1319 microversion: 2.1 time: 0.158480 Jul 21 10:48:46.128440 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 154/306] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:48:45 2022] GET /compute/v2.1/servers/dc183ff4-10bd-4827-a6a8-17f6b6d739be => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:48:46.408574 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-6023b270-ce1c-4f4c-a6a2-ad583b8e16ff tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:48:46.409174 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-6023b270-ce1c-4f4c-a6a2-ad583b8e16ff tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: a54643be-3f53-4fe5-bab0-786b71d627bb] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:48:46.415559 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6023b270-ce1c-4f4c-a6a2-ad583b8e16ff tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:46.416733 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6023b270-ce1c-4f4c-a6a2-ad583b8e16ff tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:46.417604 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6023b270-ce1c-4f4c-a6a2-ad583b8e16ff tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:46.418305 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6023b270-ce1c-4f4c-a6a2-ad583b8e16ff tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:46.587868 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-6023b270-ce1c-4f4c-a6a2-ad583b8e16ff tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:46.597086 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-6023b270-ce1c-4f4c-a6a2-ad583b8e16ff tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb" status: 200 len: 1372 microversion: 2.1 time: 0.192373 Jul 21 10:48:46.597686 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 153/307] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:48:46 2022] GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb => generated 1372 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:48:46.866938 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-ecf301cf-8280-42f7-9725-6fb76f4a61ba tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:48:46.867751 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-ecf301cf-8280-42f7-9725-6fb76f4a61ba tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:48:46.874153 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ecf301cf-8280-42f7-9725-6fb76f4a61ba tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:46.874692 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ecf301cf-8280-42f7-9725-6fb76f4a61ba tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:46.875456 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ecf301cf-8280-42f7-9725-6fb76f4a61ba tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:46.875885 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ecf301cf-8280-42f7-9725-6fb76f4a61ba tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:47.015623 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-ecf301cf-8280-42f7-9725-6fb76f4a61ba tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:47.043202 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-ecf301cf-8280-42f7-9725-6fb76f4a61ba tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:47.043202 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-ecf301cf-8280-42f7-9725-6fb76f4a61ba tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:47.043202 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-ecf301cf-8280-42f7-9725-6fb76f4a61ba tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1723 microversion: 2.20 time: 0.168763 Jul 21 10:48:47.043750 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 155/308] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:48:46 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:48:47.146317 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-35e256a2-61bd-4215-8f7e-d35a7f3a53bd tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:48:47.147032 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-35e256a2-61bd-4215-8f7e-d35a7f3a53bd tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] [instance: dc183ff4-10bd-4827-a6a8-17f6b6d739be] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:48:47.153939 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-35e256a2-61bd-4215-8f7e-d35a7f3a53bd tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:47.154625 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-35e256a2-61bd-4215-8f7e-d35a7f3a53bd tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:47.155392 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-35e256a2-61bd-4215-8f7e-d35a7f3a53bd tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:47.155828 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-35e256a2-61bd-4215-8f7e-d35a7f3a53bd tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:47.287466 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-35e256a2-61bd-4215-8f7e-d35a7f3a53bd tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ccc2d61c7045a8abba95e7cd002a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24d5a2477eb74d5da5911b37f9031110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:47.297145 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-35e256a2-61bd-4215-8f7e-d35a7f3a53bd tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] 10.222.0.48 "GET /compute/v2.1/servers/dc183ff4-10bd-4827-a6a8-17f6b6d739be" status: 200 len: 1319 microversion: 2.1 time: 0.155041 Jul 21 10:48:47.297917 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 154/309] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:48:47 2022] GET /compute/v2.1/servers/dc183ff4-10bd-4827-a6a8-17f6b6d739be => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:48:47.621627 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-4b1b463d-b2c2-4b5a-9f5b-f61275a05fae tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:48:47.622323 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-4b1b463d-b2c2-4b5a-9f5b-f61275a05fae tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: a54643be-3f53-4fe5-bab0-786b71d627bb] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:48:47.630140 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-4b1b463d-b2c2-4b5a-9f5b-f61275a05fae tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:47.630800 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-4b1b463d-b2c2-4b5a-9f5b-f61275a05fae tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:47.631657 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-4b1b463d-b2c2-4b5a-9f5b-f61275a05fae tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:47.632287 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-4b1b463d-b2c2-4b5a-9f5b-f61275a05fae tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:47.833585 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-4b1b463d-b2c2-4b5a-9f5b-f61275a05fae tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:47.842299 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-4b1b463d-b2c2-4b5a-9f5b-f61275a05fae tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb" status: 200 len: 1372 microversion: 2.1 time: 0.230646 Jul 21 10:48:47.843208 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 156/310] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:48:47 2022] GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb => generated 1372 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:48:48.050276 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-60633cfa-bf29-47c9-9c30-f35f2842801d tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:48:48.050908 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-60633cfa-bf29-47c9-9c30-f35f2842801d tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:48:48.056980 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-60633cfa-bf29-47c9-9c30-f35f2842801d tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:48.061582 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-60633cfa-bf29-47c9-9c30-f35f2842801d tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:48.061582 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-60633cfa-bf29-47c9-9c30-f35f2842801d tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:48.061582 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-60633cfa-bf29-47c9-9c30-f35f2842801d tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:48.203407 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-60633cfa-bf29-47c9-9c30-f35f2842801d tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:48.211711 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-60633cfa-bf29-47c9-9c30-f35f2842801d tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:48.213429 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-60633cfa-bf29-47c9-9c30-f35f2842801d tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:48.215018 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-60633cfa-bf29-47c9-9c30-f35f2842801d tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1723 microversion: 2.20 time: 0.168508 Jul 21 10:48:48.215897 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 155/311] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:48:48 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:48:48.321432 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-fac3d9ff-f9c4-4124-9a88-7518b8021fed tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:48:48.322064 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-fac3d9ff-f9c4-4124-9a88-7518b8021fed tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] [instance: dc183ff4-10bd-4827-a6a8-17f6b6d739be] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:48:48.330824 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fac3d9ff-f9c4-4124-9a88-7518b8021fed tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:48.332362 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fac3d9ff-f9c4-4124-9a88-7518b8021fed tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:48.333635 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fac3d9ff-f9c4-4124-9a88-7518b8021fed tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:48.334752 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fac3d9ff-f9c4-4124-9a88-7518b8021fed tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:48.478922 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-fac3d9ff-f9c4-4124-9a88-7518b8021fed tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ccc2d61c7045a8abba95e7cd002a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24d5a2477eb74d5da5911b37f9031110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:48.488134 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-fac3d9ff-f9c4-4124-9a88-7518b8021fed tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] 10.222.0.48 "GET /compute/v2.1/servers/dc183ff4-10bd-4827-a6a8-17f6b6d739be" status: 200 len: 1319 microversion: 2.1 time: 0.170217 Jul 21 10:48:48.489261 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 157/312] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:48:48 2022] GET /compute/v2.1/servers/dc183ff4-10bd-4827-a6a8-17f6b6d739be => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:48:48.860482 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-9bf3997c-bcc2-4712-9f54-eff2ec633518 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:48:48.861144 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-9bf3997c-bcc2-4712-9f54-eff2ec633518 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: a54643be-3f53-4fe5-bab0-786b71d627bb] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:48:48.866998 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9bf3997c-bcc2-4712-9f54-eff2ec633518 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:48.867444 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9bf3997c-bcc2-4712-9f54-eff2ec633518 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:48.868198 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9bf3997c-bcc2-4712-9f54-eff2ec633518 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:48.868624 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9bf3997c-bcc2-4712-9f54-eff2ec633518 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:49.002526 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-9bf3997c-bcc2-4712-9f54-eff2ec633518 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:49.010078 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-9bf3997c-bcc2-4712-9f54-eff2ec633518 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb" status: 200 len: 1372 microversion: 2.1 time: 0.153655 Jul 21 10:48:49.010721 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 156/313] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:48:48 2022] GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb => generated 1372 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:48:49.234352 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-d0b6e6e4-58d6-4d6c-b664-d6879cb70d19 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:48:49.235092 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-d0b6e6e4-58d6-4d6c-b664-d6879cb70d19 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:48:49.241710 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d0b6e6e4-58d6-4d6c-b664-d6879cb70d19 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:49.242197 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d0b6e6e4-58d6-4d6c-b664-d6879cb70d19 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:49.243078 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d0b6e6e4-58d6-4d6c-b664-d6879cb70d19 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:49.243562 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d0b6e6e4-58d6-4d6c-b664-d6879cb70d19 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:49.383456 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-d0b6e6e4-58d6-4d6c-b664-d6879cb70d19 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:49.391810 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-d0b6e6e4-58d6-4d6c-b664-d6879cb70d19 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:49.393322 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-d0b6e6e4-58d6-4d6c-b664-d6879cb70d19 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:49.394463 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-d0b6e6e4-58d6-4d6c-b664-d6879cb70d19 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1723 microversion: 2.20 time: 0.164739 Jul 21 10:48:49.395041 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 158/314] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:48:49 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:48:49.504890 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-7836bdcb-634f-4dbf-b998-7ff74c568164 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:48:49.505649 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-7836bdcb-634f-4dbf-b998-7ff74c568164 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] [instance: dc183ff4-10bd-4827-a6a8-17f6b6d739be] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:48:49.512643 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7836bdcb-634f-4dbf-b998-7ff74c568164 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:49.513123 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7836bdcb-634f-4dbf-b998-7ff74c568164 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:49.513882 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7836bdcb-634f-4dbf-b998-7ff74c568164 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:49.514339 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7836bdcb-634f-4dbf-b998-7ff74c568164 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:49.645601 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-7836bdcb-634f-4dbf-b998-7ff74c568164 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ccc2d61c7045a8abba95e7cd002a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24d5a2477eb74d5da5911b37f9031110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:49.653378 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-7836bdcb-634f-4dbf-b998-7ff74c568164 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] 10.222.0.48 "GET /compute/v2.1/servers/dc183ff4-10bd-4827-a6a8-17f6b6d739be" status: 200 len: 1508 microversion: 2.1 time: 0.152277 Jul 21 10:48:49.654144 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 157/315] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:48:49 2022] GET /compute/v2.1/servers/dc183ff4-10bd-4827-a6a8-17f6b6d739be => generated 1508 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:48:50.027843 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-54569c51-d16d-4ec3-a6d7-b44b4dd6cf34 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:48:50.028369 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-54569c51-d16d-4ec3-a6d7-b44b4dd6cf34 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: a54643be-3f53-4fe5-bab0-786b71d627bb] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:48:50.034460 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-54569c51-d16d-4ec3-a6d7-b44b4dd6cf34 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:50.034942 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-54569c51-d16d-4ec3-a6d7-b44b4dd6cf34 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:50.035696 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-54569c51-d16d-4ec3-a6d7-b44b4dd6cf34 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:50.036133 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-54569c51-d16d-4ec3-a6d7-b44b4dd6cf34 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:50.164921 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-54569c51-d16d-4ec3-a6d7-b44b4dd6cf34 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:50.176898 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-54569c51-d16d-4ec3-a6d7-b44b4dd6cf34 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb" status: 200 len: 1372 microversion: 2.1 time: 0.153037 Jul 21 10:48:50.177479 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 159/316] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:48:50 2022] GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb => generated 1372 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:48:50.416293 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-fe950b4c-667d-41d2-9056-96b91a74813b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:48:50.416903 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-fe950b4c-667d-41d2-9056-96b91a74813b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:48:50.423879 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-fe950b4c-667d-41d2-9056-96b91a74813b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:50.424326 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-fe950b4c-667d-41d2-9056-96b91a74813b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:50.425144 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-fe950b4c-667d-41d2-9056-96b91a74813b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:50.425577 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-fe950b4c-667d-41d2-9056-96b91a74813b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:50.575042 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-fe950b4c-667d-41d2-9056-96b91a74813b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:50.583167 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-fe950b4c-667d-41d2-9056-96b91a74813b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:50.584674 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-fe950b4c-667d-41d2-9056-96b91a74813b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:50.585821 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-fe950b4c-667d-41d2-9056-96b91a74813b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1723 microversion: 2.20 time: 0.173361 Jul 21 10:48:50.586365 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 158/317] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:48:50 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:48:51.197184 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-65f256cd-bc3c-4bfd-bdb3-e5fd01dd4378 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:48:51.198014 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-65f256cd-bc3c-4bfd-bdb3-e5fd01dd4378 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: a54643be-3f53-4fe5-bab0-786b71d627bb] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:48:51.200755 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:48:51.206416 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-65f256cd-bc3c-4bfd-bdb3-e5fd01dd4378 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:51.206416 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-65f256cd-bc3c-4bfd-bdb3-e5fd01dd4378 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:51.207714 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-65f256cd-bc3c-4bfd-bdb3-e5fd01dd4378 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:51.208460 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-65f256cd-bc3c-4bfd-bdb3-e5fd01dd4378 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:51.345901 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-65f256cd-bc3c-4bfd-bdb3-e5fd01dd4378 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:51.353497 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-65f256cd-bc3c-4bfd-bdb3-e5fd01dd4378 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb" status: 200 len: 1372 microversion: 2.1 time: 0.162670 Jul 21 10:48:51.354065 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 160/318] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:48:51 2022] GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb => generated 1372 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:48:51.605425 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-3402f03e-5633-4ecb-ac18-c3933232fcaa tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:48:51.606133 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-3402f03e-5633-4ecb-ac18-c3933232fcaa tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:48:51.612991 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3402f03e-5633-4ecb-ac18-c3933232fcaa tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:51.613508 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3402f03e-5633-4ecb-ac18-c3933232fcaa tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:51.614332 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3402f03e-5633-4ecb-ac18-c3933232fcaa tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:51.614876 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3402f03e-5633-4ecb-ac18-c3933232fcaa tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:51.748116 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-3402f03e-5633-4ecb-ac18-c3933232fcaa tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:51.756661 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-3402f03e-5633-4ecb-ac18-c3933232fcaa tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:51.758169 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-3402f03e-5633-4ecb-ac18-c3933232fcaa tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:51.759404 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-3402f03e-5633-4ecb-ac18-c3933232fcaa tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1723 microversion: 2.20 time: 0.158037 Jul 21 10:48:51.760145 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 159/319] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:48:51 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:48:52.372213 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-505e235d-002b-4737-be0a-9b54f66b608e tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:48:52.372847 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-505e235d-002b-4737-be0a-9b54f66b608e tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: a54643be-3f53-4fe5-bab0-786b71d627bb] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:48:52.378939 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-505e235d-002b-4737-be0a-9b54f66b608e tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:52.379376 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-505e235d-002b-4737-be0a-9b54f66b608e tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:52.380166 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-505e235d-002b-4737-be0a-9b54f66b608e tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:52.380598 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-505e235d-002b-4737-be0a-9b54f66b608e tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:52.471319 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [req-56b61185-a258-4b3b-958f-fb6e8fe8375c req-6e04b176-597a-443b-b361-67df578bc809 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a54643be-3f53-4fe5-bab0-786b71d627bb", "name": "network-vif-plugged", "status": "completed", "tag": "6ac84834-b64c-48e6-a97a-aed57229fe41"}]} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:48:52.482331 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-56b61185-a258-4b3b-958f-fb6e8fe8375c req-6e04b176-597a-443b-b361-67df578bc809 service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:52.483041 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-56b61185-a258-4b3b-958f-fb6e8fe8375c req-6e04b176-597a-443b-b361-67df578bc809 service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:52.495612 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.compute.server_external_events [req-56b61185-a258-4b3b-958f-fb6e8fe8375c req-6e04b176-597a-443b-b361-67df578bc809 service nova] Creating event network-vif-plugged:6ac84834-b64c-48e6-a97a-aed57229fe41 for instance a54643be-3f53-4fe5-bab0-786b71d627bb on hv-cinder-84980 Jul 21 10:48:52.500917 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [req-56b61185-a258-4b3b-958f-fb6e8fe8375c req-6e04b176-597a-443b-b361-67df578bc809 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034100 Jul 21 10:48:52.501863 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 160/320] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 21 10:48:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:48:52.522968 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-505e235d-002b-4737-be0a-9b54f66b608e tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:52.531686 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-505e235d-002b-4737-be0a-9b54f66b608e tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb" status: 200 len: 1372 microversion: 2.1 time: 0.164566 Jul 21 10:48:52.532590 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 161/321] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:48:52 2022] GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb => generated 1372 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:48:52.780712 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-87f292ec-0a60-42a4-8b44-63da9e92e2cd tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:48:52.781415 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-87f292ec-0a60-42a4-8b44-63da9e92e2cd tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:48:52.787735 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-87f292ec-0a60-42a4-8b44-63da9e92e2cd tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:52.788272 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-87f292ec-0a60-42a4-8b44-63da9e92e2cd tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:52.790072 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-87f292ec-0a60-42a4-8b44-63da9e92e2cd tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:52.790072 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-87f292ec-0a60-42a4-8b44-63da9e92e2cd tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:52.925608 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-87f292ec-0a60-42a4-8b44-63da9e92e2cd tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:52.934119 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-87f292ec-0a60-42a4-8b44-63da9e92e2cd tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:52.935646 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-87f292ec-0a60-42a4-8b44-63da9e92e2cd tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:52.936941 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-87f292ec-0a60-42a4-8b44-63da9e92e2cd tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1723 microversion: 2.20 time: 0.161625 Jul 21 10:48:52.937488 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 161/322] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:48:52 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:48:53.549259 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-86af60d7-6de5-41b0-8422-80d05e3d2a75 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:48:53.549873 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-86af60d7-6de5-41b0-8422-80d05e3d2a75 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: a54643be-3f53-4fe5-bab0-786b71d627bb] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:48:53.558008 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-86af60d7-6de5-41b0-8422-80d05e3d2a75 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:53.558008 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-86af60d7-6de5-41b0-8422-80d05e3d2a75 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:53.558874 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-86af60d7-6de5-41b0-8422-80d05e3d2a75 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:53.559494 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-86af60d7-6de5-41b0-8422-80d05e3d2a75 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:53.707858 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-86af60d7-6de5-41b0-8422-80d05e3d2a75 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:53.715387 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-86af60d7-6de5-41b0-8422-80d05e3d2a75 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb" status: 200 len: 1372 microversion: 2.1 time: 0.169995 Jul 21 10:48:53.715950 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 162/323] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:48:53 2022] GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb => generated 1372 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:48:53.955180 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-33247a37-d707-47de-b07c-9665e234aeb5 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:48:53.955855 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-33247a37-d707-47de-b07c-9665e234aeb5 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:48:53.962763 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-33247a37-d707-47de-b07c-9665e234aeb5 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:53.963214 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-33247a37-d707-47de-b07c-9665e234aeb5 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:53.964637 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-33247a37-d707-47de-b07c-9665e234aeb5 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:53.965143 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-33247a37-d707-47de-b07c-9665e234aeb5 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:54.105641 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-33247a37-d707-47de-b07c-9665e234aeb5 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:54.114810 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-33247a37-d707-47de-b07c-9665e234aeb5 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:54.116656 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-33247a37-d707-47de-b07c-9665e234aeb5 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:54.117635 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-33247a37-d707-47de-b07c-9665e234aeb5 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1723 microversion: 2.20 time: 0.166292 Jul 21 10:48:54.118309 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 162/324] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:48:53 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:48:54.732849 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-a9639410-6193-4b47-a53e-b0dcb92c6b5c tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:48:54.734020 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-a9639410-6193-4b47-a53e-b0dcb92c6b5c tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: a54643be-3f53-4fe5-bab0-786b71d627bb] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:48:54.740165 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a9639410-6193-4b47-a53e-b0dcb92c6b5c tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:54.740615 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a9639410-6193-4b47-a53e-b0dcb92c6b5c tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:54.741415 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a9639410-6193-4b47-a53e-b0dcb92c6b5c tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:54.741850 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a9639410-6193-4b47-a53e-b0dcb92c6b5c tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:54.882281 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-a9639410-6193-4b47-a53e-b0dcb92c6b5c tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:54.890393 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-a9639410-6193-4b47-a53e-b0dcb92c6b5c tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb" status: 200 len: 1372 microversion: 2.1 time: 0.161881 Jul 21 10:48:54.891022 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 163/325] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:48:54 2022] GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb => generated 1372 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:48:55.137373 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-432399e4-1040-4b3a-9672-5a04723ca62f tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:48:55.137915 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-432399e4-1040-4b3a-9672-5a04723ca62f tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:48:55.144690 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-432399e4-1040-4b3a-9672-5a04723ca62f tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:55.145137 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-432399e4-1040-4b3a-9672-5a04723ca62f tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:55.148016 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-432399e4-1040-4b3a-9672-5a04723ca62f tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:55.148016 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-432399e4-1040-4b3a-9672-5a04723ca62f tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:55.285704 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-432399e4-1040-4b3a-9672-5a04723ca62f tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:55.296345 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-432399e4-1040-4b3a-9672-5a04723ca62f tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:55.298128 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-432399e4-1040-4b3a-9672-5a04723ca62f tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:55.299330 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-432399e4-1040-4b3a-9672-5a04723ca62f tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1723 microversion: 2.20 time: 0.166605 Jul 21 10:48:55.300157 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 163/326] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:48:55 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:48:55.906693 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-dc946649-72b8-49d0-9046-a99dec114c8b tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:48:55.907417 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-dc946649-72b8-49d0-9046-a99dec114c8b tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: a54643be-3f53-4fe5-bab0-786b71d627bb] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:48:55.914117 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-dc946649-72b8-49d0-9046-a99dec114c8b tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:55.916891 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-dc946649-72b8-49d0-9046-a99dec114c8b tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:55.916891 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-dc946649-72b8-49d0-9046-a99dec114c8b tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:55.916891 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-dc946649-72b8-49d0-9046-a99dec114c8b tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:56.051332 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-dc946649-72b8-49d0-9046-a99dec114c8b tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:56.060118 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-dc946649-72b8-49d0-9046-a99dec114c8b tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb" status: 200 len: 1566 microversion: 2.1 time: 0.157214 Jul 21 10:48:56.060696 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 164/327] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:48:55 2022] GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:48:56.076578 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-23c46510-e323-4760-abe9-de2a595e4a72 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:48:56.077075 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-23c46510-e323-4760-abe9-de2a595e4a72 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: a54643be-3f53-4fe5-bab0-786b71d627bb] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:48:56.083491 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-23c46510-e323-4760-abe9-de2a595e4a72 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:56.083952 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-23c46510-e323-4760-abe9-de2a595e4a72 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:56.084983 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-23c46510-e323-4760-abe9-de2a595e4a72 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:56.085423 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-23c46510-e323-4760-abe9-de2a595e4a72 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:56.167796 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-23c46510-e323-4760-abe9-de2a595e4a72 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094613 Jul 21 10:48:56.168401 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 164/328] 10.222.0.48 () {58 vars in 1274 bytes} [Thu Jul 21 10:48:56 2022] GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:48:56.318833 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-7537c7bf-fc0b-4e6e-b049-30a36d622fbb tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:48:56.319451 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-7537c7bf-fc0b-4e6e-b049-30a36d622fbb tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:48:56.327008 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7537c7bf-fc0b-4e6e-b049-30a36d622fbb tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:56.327471 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7537c7bf-fc0b-4e6e-b049-30a36d622fbb tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:56.328577 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7537c7bf-fc0b-4e6e-b049-30a36d622fbb tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:56.329195 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7537c7bf-fc0b-4e6e-b049-30a36d622fbb tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:56.594589 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-7537c7bf-fc0b-4e6e-b049-30a36d622fbb tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:56.605964 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-7537c7bf-fc0b-4e6e-b049-30a36d622fbb tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:56.607788 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-7537c7bf-fc0b-4e6e-b049-30a36d622fbb tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:56.609038 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-7537c7bf-fc0b-4e6e-b049-30a36d622fbb tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1723 microversion: 2.20 time: 0.294034 Jul 21 10:48:56.609591 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 165/329] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:48:56 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1723 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:48:57.380493 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [req-2d365064-09cd-4b1e-b5c5-bdf644182f96 req-6a385c99-f0e2-4e04-a2af-6f35d3e57e9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a54643be-3f53-4fe5-bab0-786b71d627bb", "tag": "6ac84834-b64c-48e6-a97a-aed57229fe41"}]} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:48:57.389271 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-2d365064-09cd-4b1e-b5c5-bdf644182f96 req-6a385c99-f0e2-4e04-a2af-6f35d3e57e9b service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:57.389713 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-2d365064-09cd-4b1e-b5c5-bdf644182f96 req-6a385c99-f0e2-4e04-a2af-6f35d3e57e9b service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:57.400804 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.compute.server_external_events [req-2d365064-09cd-4b1e-b5c5-bdf644182f96 req-6a385c99-f0e2-4e04-a2af-6f35d3e57e9b service nova] Creating event network-changed:6ac84834-b64c-48e6-a97a-aed57229fe41 for instance a54643be-3f53-4fe5-bab0-786b71d627bb on hv-cinder-84980 Jul 21 10:48:57.407430 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [req-2d365064-09cd-4b1e-b5c5-bdf644182f96 req-6a385c99-f0e2-4e04-a2af-6f35d3e57e9b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034276 Jul 21 10:48:57.408347 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 165/330] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 21 10:48:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:48:57.648339 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-2dcafd9f-9458-48fc-bc7d-02d34c7d38b7 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:48:57.656918 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-2dcafd9f-9458-48fc-bc7d-02d34c7d38b7 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:48:57.677152 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2dcafd9f-9458-48fc-bc7d-02d34c7d38b7 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:57.679381 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2dcafd9f-9458-48fc-bc7d-02d34c7d38b7 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:57.684583 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2dcafd9f-9458-48fc-bc7d-02d34c7d38b7 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:57.685577 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2dcafd9f-9458-48fc-bc7d-02d34c7d38b7 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:57.945068 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-2dcafd9f-9458-48fc-bc7d-02d34c7d38b7 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:57.957973 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-2dcafd9f-9458-48fc-bc7d-02d34c7d38b7 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:57.963364 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-2dcafd9f-9458-48fc-bc7d-02d34c7d38b7 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:57.965242 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-2dcafd9f-9458-48fc-bc7d-02d34c7d38b7 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1723 microversion: 2.20 time: 0.341168 Jul 21 10:48:57.966183 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 166/331] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:48:57 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1723 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:48:58.986247 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-8aa4a955-7a73-45ed-9d6e-e23c22f3297e tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:48:58.987046 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-8aa4a955-7a73-45ed-9d6e-e23c22f3297e tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:48:58.989060 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=1 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:48:58.996332 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8aa4a955-7a73-45ed-9d6e-e23c22f3297e tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:58.996775 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8aa4a955-7a73-45ed-9d6e-e23c22f3297e tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:58.997963 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8aa4a955-7a73-45ed-9d6e-e23c22f3297e tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:48:58.998394 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8aa4a955-7a73-45ed-9d6e-e23c22f3297e tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:48:59.020953 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:48:59.170466 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-8aa4a955-7a73-45ed-9d6e-e23c22f3297e tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:59.179484 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-8aa4a955-7a73-45ed-9d6e-e23c22f3297e tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:59.180991 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-8aa4a955-7a73-45ed-9d6e-e23c22f3297e tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:48:59.182135 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-8aa4a955-7a73-45ed-9d6e-e23c22f3297e tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1744 microversion: 2.20 time: 0.201346 Jul 21 10:48:59.182748 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 166/332] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:48:58 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1744 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:49:00.204532 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-d632bd74-17fa-4f92-b4f5-95fe0fdeda0e tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:49:00.205145 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-d632bd74-17fa-4f92-b4f5-95fe0fdeda0e tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:49:00.212814 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d632bd74-17fa-4f92-b4f5-95fe0fdeda0e tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:00.213263 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d632bd74-17fa-4f92-b4f5-95fe0fdeda0e tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:00.214036 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d632bd74-17fa-4f92-b4f5-95fe0fdeda0e tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:00.214469 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d632bd74-17fa-4f92-b4f5-95fe0fdeda0e tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:00.353787 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-d632bd74-17fa-4f92-b4f5-95fe0fdeda0e tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:00.363915 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-d632bd74-17fa-4f92-b4f5-95fe0fdeda0e tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:00.365419 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-d632bd74-17fa-4f92-b4f5-95fe0fdeda0e tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:00.367791 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-d632bd74-17fa-4f92-b4f5-95fe0fdeda0e tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1744 microversion: 2.20 time: 0.168036 Jul 21 10:49:00.368801 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 167/333] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:49:00 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1744 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:49:00.394743 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [req-03cfc67c-604e-460b-9769-ea993be73120 req-250209d4-ffcf-4224-994a-6c5f3e58e9ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e730525-7ce4-4a5a-8023-84cae6b1da3d", "name": "network-vif-plugged", "status": "completed", "tag": "e0efd748-6569-4435-ab16-d9acccb72164"}]} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:49:00.406341 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-03cfc67c-604e-460b-9769-ea993be73120 req-250209d4-ffcf-4224-994a-6c5f3e58e9ed service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:00.406881 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-03cfc67c-604e-460b-9769-ea993be73120 req-250209d4-ffcf-4224-994a-6c5f3e58e9ed service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:00.418210 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.compute.server_external_events [req-03cfc67c-604e-460b-9769-ea993be73120 req-250209d4-ffcf-4224-994a-6c5f3e58e9ed service nova] Creating event network-vif-plugged:e0efd748-6569-4435-ab16-d9acccb72164 for instance 1e730525-7ce4-4a5a-8023-84cae6b1da3d on hv-cinder-84980 Jul 21 10:49:00.423816 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [req-03cfc67c-604e-460b-9769-ea993be73120 req-250209d4-ffcf-4224-994a-6c5f3e58e9ed service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034269 Jul 21 10:49:00.424375 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 167/334] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 21 10:49:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 10:49:01.387475 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-a442b972-5edc-4b8e-a0c2-396e55b1ab1c tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:49:01.388743 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-a442b972-5edc-4b8e-a0c2-396e55b1ab1c tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:49:01.395754 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a442b972-5edc-4b8e-a0c2-396e55b1ab1c tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:01.396196 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a442b972-5edc-4b8e-a0c2-396e55b1ab1c tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:01.396962 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a442b972-5edc-4b8e-a0c2-396e55b1ab1c tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:01.397388 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a442b972-5edc-4b8e-a0c2-396e55b1ab1c tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:01.538355 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-a442b972-5edc-4b8e-a0c2-396e55b1ab1c tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:01.540615 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell1:SELECT=100 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:49:01.547635 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-a442b972-5edc-4b8e-a0c2-396e55b1ab1c tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:01.549127 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-a442b972-5edc-4b8e-a0c2-396e55b1ab1c tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:01.550254 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-a442b972-5edc-4b8e-a0c2-396e55b1ab1c tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1744 microversion: 2.20 time: 0.166641 Jul 21 10:49:01.550824 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 168/335] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:49:01 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1744 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:49:02.570463 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-ce912496-a1ad-419d-b81c-455f8797663d tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:49:02.571209 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-ce912496-a1ad-419d-b81c-455f8797663d tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:49:02.578438 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ce912496-a1ad-419d-b81c-455f8797663d tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:02.578925 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ce912496-a1ad-419d-b81c-455f8797663d tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:02.579776 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ce912496-a1ad-419d-b81c-455f8797663d tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:02.580153 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ce912496-a1ad-419d-b81c-455f8797663d tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:02.775843 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-ce912496-a1ad-419d-b81c-455f8797663d tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:02.784744 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-ce912496-a1ad-419d-b81c-455f8797663d tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:02.786364 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-ce912496-a1ad-419d-b81c-455f8797663d tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:02.787747 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-ce912496-a1ad-419d-b81c-455f8797663d tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1744 microversion: 2.20 time: 0.222174 Jul 21 10:49:02.788523 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 168/336] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:49:02 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1744 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:49:03.808149 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-1b597506-834d-4234-8796-a911a4b54114 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:49:03.808845 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-1b597506-834d-4234-8796-a911a4b54114 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:49:03.816752 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1b597506-834d-4234-8796-a911a4b54114 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:03.817199 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1b597506-834d-4234-8796-a911a4b54114 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:03.817977 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1b597506-834d-4234-8796-a911a4b54114 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:03.818413 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1b597506-834d-4234-8796-a911a4b54114 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:04.072587 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-1b597506-834d-4234-8796-a911a4b54114 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:04.083048 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-1b597506-834d-4234-8796-a911a4b54114 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:04.088582 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-1b597506-834d-4234-8796-a911a4b54114 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:04.089868 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-1b597506-834d-4234-8796-a911a4b54114 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1744 microversion: 2.20 time: 0.286959 Jul 21 10:49:04.091163 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 169/337] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:49:03 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1744 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:49:05.109402 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-d14e6a7c-5fcc-4f28-826d-b9e3522fd636 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:49:05.110073 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-d14e6a7c-5fcc-4f28-826d-b9e3522fd636 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:49:05.117908 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d14e6a7c-5fcc-4f28-826d-b9e3522fd636 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:05.118772 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d14e6a7c-5fcc-4f28-826d-b9e3522fd636 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:05.120126 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d14e6a7c-5fcc-4f28-826d-b9e3522fd636 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:05.120695 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d14e6a7c-5fcc-4f28-826d-b9e3522fd636 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:05.384167 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-d14e6a7c-5fcc-4f28-826d-b9e3522fd636 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:05.392806 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-d14e6a7c-5fcc-4f28-826d-b9e3522fd636 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:05.394316 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-d14e6a7c-5fcc-4f28-826d-b9e3522fd636 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:05.395490 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-d14e6a7c-5fcc-4f28-826d-b9e3522fd636 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1744 microversion: 2.20 time: 0.290173 Jul 21 10:49:05.396049 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 169/338] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:49:05 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1744 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:49:06.416807 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-25dc3c4c-b5ad-4066-8266-7186975d8208 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:49:06.418223 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-25dc3c4c-b5ad-4066-8266-7186975d8208 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:49:06.425749 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-25dc3c4c-b5ad-4066-8266-7186975d8208 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:06.426451 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-25dc3c4c-b5ad-4066-8266-7186975d8208 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:06.427402 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-25dc3c4c-b5ad-4066-8266-7186975d8208 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:06.427846 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-25dc3c4c-b5ad-4066-8266-7186975d8208 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:06.622737 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-25dc3c4c-b5ad-4066-8266-7186975d8208 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:06.630916 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-25dc3c4c-b5ad-4066-8266-7186975d8208 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:06.632434 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-25dc3c4c-b5ad-4066-8266-7186975d8208 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:06.633584 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-25dc3c4c-b5ad-4066-8266-7186975d8208 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1744 microversion: 2.20 time: 0.222969 Jul 21 10:49:06.634146 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 170/339] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:49:06 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1744 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:49:07.655649 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-802766cd-bfe0-40b4-8728-2e6064b207cf tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:49:07.657746 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-802766cd-bfe0-40b4-8728-2e6064b207cf tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:49:07.666140 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-802766cd-bfe0-40b4-8728-2e6064b207cf tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:07.666602 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-802766cd-bfe0-40b4-8728-2e6064b207cf tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:07.667607 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-802766cd-bfe0-40b4-8728-2e6064b207cf tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:07.668188 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-802766cd-bfe0-40b4-8728-2e6064b207cf tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:07.828727 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-802766cd-bfe0-40b4-8728-2e6064b207cf tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:07.837447 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-802766cd-bfe0-40b4-8728-2e6064b207cf tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:07.839011 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-802766cd-bfe0-40b4-8728-2e6064b207cf tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:07.840188 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-802766cd-bfe0-40b4-8728-2e6064b207cf tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1744 microversion: 2.20 time: 0.191695 Jul 21 10:49:07.841208 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 170/340] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:49:07 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1744 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:49:08.862522 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-6c343030-d551-4571-9f99-90fa5464ac02 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:49:08.863161 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-6c343030-d551-4571-9f99-90fa5464ac02 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:49:08.870654 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6c343030-d551-4571-9f99-90fa5464ac02 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:08.872178 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6c343030-d551-4571-9f99-90fa5464ac02 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:08.873309 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6c343030-d551-4571-9f99-90fa5464ac02 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:08.874502 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6c343030-d551-4571-9f99-90fa5464ac02 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:09.025683 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-6c343030-d551-4571-9f99-90fa5464ac02 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:09.035499 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-6c343030-d551-4571-9f99-90fa5464ac02 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:09.037018 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-6c343030-d551-4571-9f99-90fa5464ac02 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:09.038168 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-6c343030-d551-4571-9f99-90fa5464ac02 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1739 microversion: 2.20 time: 0.181243 Jul 21 10:49:09.038787 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 171/341] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:49:08 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1739 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:49:09.785399 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-b4aa11cc-2bcd-4c45-b32d-99a33703e425 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Action: 'create', calling method: .version_select at 0x7f79634ceee0>, body: {"keypair": {"name": "tempest-keypair-789417223", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFOb167kLHVlEFmmy1B9tcBxtw8hlP2lW3jSStannUsxxgy5V9ehE6o+AHn/BK6pjJmfkAtKsdZj0eWQoTHONay0V7HUALPtcsZAher2Jv+u3ZtyJDPX0FhJOFVu11NODg=="}} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:49:09.822732 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.quota [None req-b4aa11cc-2bcd-4c45-b32d-99a33703e425 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Getting quotas for project 0dc215aadb5345d791945658832aae4a. Resources: {'key_pairs'} {{(pid=124868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 10:49:09.835452 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.quota [None req-b4aa11cc-2bcd-4c45-b32d-99a33703e425 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Getting quotas for user 906e4bc4e9cc45ecb01cfca7918e461d and project 0dc215aadb5345d791945658832aae4a. Resources: {'key_pairs'} {{(pid=124868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 10:49:09.978808 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-b4aa11cc-2bcd-4c45-b32d-99a33703e425 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.197003 Jul 21 10:49:09.980219 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 171/342] 10.222.0.48 () {60 vars in 1158 bytes} [Thu Jul 21 10:49:09 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:49:10.058522 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-dac3e27a-6d96-401d-834a-ba9adb3da3da tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:49:10.059955 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-dac3e27a-6d96-401d-834a-ba9adb3da3da tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:49:10.069710 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-dac3e27a-6d96-401d-834a-ba9adb3da3da tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:10.071111 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-dac3e27a-6d96-401d-834a-ba9adb3da3da tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:10.074779 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-dac3e27a-6d96-401d-834a-ba9adb3da3da tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:10.075499 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-dac3e27a-6d96-401d-834a-ba9adb3da3da tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:10.658433 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-dac3e27a-6d96-401d-834a-ba9adb3da3da tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:10.673772 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-dac3e27a-6d96-401d-834a-ba9adb3da3da tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:10.681293 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-dac3e27a-6d96-401d-834a-ba9adb3da3da tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:10.688746 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-dac3e27a-6d96-401d-834a-ba9adb3da3da tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1739 microversion: 2.20 time: 0.634388 Jul 21 10:49:10.690371 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 172/343] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:49:10 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1739 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:49:11.721900 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-bcc8954d-6e32-406d-96f2-5c9a5a9778f8 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:49:11.723463 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-bcc8954d-6e32-406d-96f2-5c9a5a9778f8 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:49:11.738228 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-bcc8954d-6e32-406d-96f2-5c9a5a9778f8 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:11.750617 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-bcc8954d-6e32-406d-96f2-5c9a5a9778f8 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:11.752243 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-bcc8954d-6e32-406d-96f2-5c9a5a9778f8 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:11.752920 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-bcc8954d-6e32-406d-96f2-5c9a5a9778f8 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:12.108592 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-bcc8954d-6e32-406d-96f2-5c9a5a9778f8 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:12.125375 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-bcc8954d-6e32-406d-96f2-5c9a5a9778f8 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:12.127455 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-bcc8954d-6e32-406d-96f2-5c9a5a9778f8 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:12.132120 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-bcc8954d-6e32-406d-96f2-5c9a5a9778f8 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1739 microversion: 2.20 time: 0.425384 Jul 21 10:49:12.143917 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 172/344] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:49:11 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1739 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:49:13.167344 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-98542dc0-6b56-489f-a0bf-79a8f74cae26 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:49:13.171351 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-98542dc0-6b56-489f-a0bf-79a8f74cae26 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:49:13.198147 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-98542dc0-6b56-489f-a0bf-79a8f74cae26 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:13.200495 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-98542dc0-6b56-489f-a0bf-79a8f74cae26 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:13.205432 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-98542dc0-6b56-489f-a0bf-79a8f74cae26 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:13.205898 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-98542dc0-6b56-489f-a0bf-79a8f74cae26 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:13.862448 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-b4523f42-cea3-46fd-a659-1ca7a9442b24 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f6f0257b-3a73-442f-8492-4caedf6103fe", "device": "/dev/sdb"}} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:49:13.865148 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-b4523f42-cea3-46fd-a659-1ca7a9442b24 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] [instance: dc183ff4-10bd-4827-a6a8-17f6b6d739be] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:49:13.877498 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b4523f42-cea3-46fd-a659-1ca7a9442b24 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:13.885117 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b4523f42-cea3-46fd-a659-1ca7a9442b24 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:13.886737 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b4523f42-cea3-46fd-a659-1ca7a9442b24 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:13.888067 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b4523f42-cea3-46fd-a659-1ca7a9442b24 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:14.093495 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-98542dc0-6b56-489f-a0bf-79a8f74cae26 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:14.106513 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-98542dc0-6b56-489f-a0bf-79a8f74cae26 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:14.109506 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-98542dc0-6b56-489f-a0bf-79a8f74cae26 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:14.111006 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-98542dc0-6b56-489f-a0bf-79a8f74cae26 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1739 microversion: 2.20 time: 0.954443 Jul 21 10:49:14.123762 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 173/345] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:49:13 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1739 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:49:14.785003 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-00ef9eb0-42c2-4fac-b966-38a8d8b66f79 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-223644886", "imageRef": "282ddb30-fa0f-489d-9cc3-a3e70e03c631", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "192d6a0f-c1f8-471a-872f-e924c6d8f479"}], "security_groups": [{"name": "tempest-securitygroup--1757408372"}], "key_name": "tempest-keypair-789417223", "user_data": "}} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:49:14.959053 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.network.neutron [None req-00ef9eb0-42c2-4fac-b966-38a8d8b66f79 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] validate_networks() for [('192d6a0f-c1f8-471a-872f-e924c6d8f479', None, None, None, None, None)] {{(pid=124867) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 10:49:15.316139 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-b4523f42-cea3-46fd-a659-1ca7a9442b24 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] 10.222.0.48 "POST /compute/v2.1/servers/dc183ff4-10bd-4827-a6a8-17f6b6d739be/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.458333 Jul 21 10:49:15.317466 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 173/346] 10.222.0.48 () {60 vars in 1322 bytes} [Thu Jul 21 10:49:13 2022] POST /compute/v2.1/servers/dc183ff4-10bd-4827-a6a8-17f6b6d739be/os-volume_attachments => generated 194 bytes in 1461 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 10:49:15.328955 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-ec04bbd9-7a57-4597-b84c-728b5a578144 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:49:15.344286 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-ec04bbd9-7a57-4597-b84c-728b5a578144 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:49:15.364107 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ec04bbd9-7a57-4597-b84c-728b5a578144 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:15.368968 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ec04bbd9-7a57-4597-b84c-728b5a578144 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:15.371422 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ec04bbd9-7a57-4597-b84c-728b5a578144 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:15.371422 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ec04bbd9-7a57-4597-b84c-728b5a578144 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:15.961078 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-ec04bbd9-7a57-4597-b84c-728b5a578144 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:15.971866 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-ec04bbd9-7a57-4597-b84c-728b5a578144 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:15.974122 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-ec04bbd9-7a57-4597-b84c-728b5a578144 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:15.975444 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-ec04bbd9-7a57-4597-b84c-728b5a578144 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1739 microversion: 2.20 time: 0.656647 Jul 21 10:49:15.976627 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 174/347] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:49:15 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1739 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:49:16.095038 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-00ef9eb0-42c2-4fac-b966-38a8d8b66f79 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Flavor limits 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 10:49:16.095630 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-00ef9eb0-42c2-4fac-b966-38a8d8b66f79 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Image limits 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 10:49:16.095735 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-00ef9eb0-42c2-4fac-b966-38a8d8b66f79 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Flavor pref 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 10:49:16.096623 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-00ef9eb0-42c2-4fac-b966-38a8d8b66f79 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Image pref 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 10:49:16.096623 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-00ef9eb0-42c2-4fac-b966-38a8d8b66f79 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 10:49:16.122312 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-00ef9eb0-42c2-4fac-b966-38a8d8b66f79 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:16.122987 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-00ef9eb0-42c2-4fac-b966-38a8d8b66f79 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:16.123896 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-00ef9eb0-42c2-4fac-b966-38a8d8b66f79 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:16.124449 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-00ef9eb0-42c2-4fac-b966-38a8d8b66f79 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:16.146728 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.quota [None req-00ef9eb0-42c2-4fac-b966-38a8d8b66f79 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Getting quotas for project 0dc215aadb5345d791945658832aae4a. Resources: {'ram', 'instances', 'cores'} {{(pid=124867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 10:49:16.151889 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.quota [None req-00ef9eb0-42c2-4fac-b966-38a8d8b66f79 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Getting quotas for user 906e4bc4e9cc45ecb01cfca7918e461d and project 0dc215aadb5345d791945658832aae4a. Resources: {'ram', 'instances', 'cores'} {{(pid=124867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 10:49:16.171972 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-00ef9eb0-42c2-4fac-b966-38a8d8b66f79 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Going to run 1 instances... {{(pid=124867) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 10:49:16.174301 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-00ef9eb0-42c2-4fac-b966-38a8d8b66f79 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='282ddb30-fa0f-489d-9cc3-a3e70e03c631',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124867) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 10:49:16.421581 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-00ef9eb0-42c2-4fac-b966-38a8d8b66f79 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.643579 Jul 21 10:49:16.443073 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-fc93e609-5ff7-48ed-899f-e9d1236b3079 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:49:16.443736 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-fc93e609-5ff7-48ed-899f-e9d1236b3079 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:49:16.453392 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 174/348] 10.222.0.48 () {60 vars in 1146 bytes} [Thu Jul 21 10:49:14 2022] POST /compute/v2.1/servers => generated 402 bytes in 1676 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 21 10:49:16.549512 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-fc93e609-5ff7-48ed-899f-e9d1236b3079 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906e4bc4e9cc45ecb01cfca7918e461d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc215aadb5345d791945658832aae4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:16.559521 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-fc93e609-5ff7-48ed-899f-e9d1236b3079 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b" status: 200 len: 1240 microversion: 2.1 time: 0.119785 Jul 21 10:49:16.560288 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 175/349] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:49:16 2022] GET /compute/v2.1/servers/73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b => generated 1240 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:49:16.998382 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-1e9c33ed-53d2-466c-b026-dfeb0787dbda tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:49:16.999050 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-1e9c33ed-53d2-466c-b026-dfeb0787dbda tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:49:17.012500 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1e9c33ed-53d2-466c-b026-dfeb0787dbda tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:17.012634 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1e9c33ed-53d2-466c-b026-dfeb0787dbda tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:17.014755 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1e9c33ed-53d2-466c-b026-dfeb0787dbda tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:17.014755 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1e9c33ed-53d2-466c-b026-dfeb0787dbda tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:17.384059 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-1e9c33ed-53d2-466c-b026-dfeb0787dbda tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:17.397292 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-1e9c33ed-53d2-466c-b026-dfeb0787dbda tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:17.410284 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-1e9c33ed-53d2-466c-b026-dfeb0787dbda tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:17.411833 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-1e9c33ed-53d2-466c-b026-dfeb0787dbda tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1739 microversion: 2.20 time: 0.418885 Jul 21 10:49:17.412565 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 175/350] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:49:16 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1739 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:49:17.591342 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-42573967-b073-47a6-989c-dd5305d6bba5 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:49:17.592176 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-42573967-b073-47a6-989c-dd5305d6bba5 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:49:17.774192 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-42573967-b073-47a6-989c-dd5305d6bba5 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906e4bc4e9cc45ecb01cfca7918e461d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc215aadb5345d791945658832aae4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:17.794108 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-42573967-b073-47a6-989c-dd5305d6bba5 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b" status: 200 len: 1240 microversion: 2.1 time: 0.209504 Jul 21 10:49:17.794872 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 176/351] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:49:17 2022] GET /compute/v2.1/servers/73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b => generated 1240 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:49:17.946055 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-5a06a42c-760d-4253-b5db-1899fe4e8fea tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Action: 'create', calling method: .version_select at 0x7f795ee3f670>, body: {"keypair": {"name": "tempest-TestShelveInstance-1816234042", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFZwDrfEQG2F2YRyAK927ScRDVaRc4DZ6iWIV0uzMgXn2/59y5N/4FgN9vk6mP8m/SNr0MDtwvX7U9md1k+shkQkyIt7lgds7ZU6fjBoB05kondlbDJJuVgVa68XuUDLUA=="}} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:49:18.010997 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.quota [None req-5a06a42c-760d-4253-b5db-1899fe4e8fea tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Getting quotas for project 620ea9c4eaa74dc5858cf93d9fcad9f1. Resources: {'key_pairs'} {{(pid=124867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 10:49:18.022025 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.quota [None req-5a06a42c-760d-4253-b5db-1899fe4e8fea tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Getting quotas for user e2e3fd195fd14b009ba56950dc542cb1 and project 620ea9c4eaa74dc5858cf93d9fcad9f1. Resources: {'key_pairs'} {{(pid=124867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 10:49:18.151961 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-5a06a42c-760d-4253-b5db-1899fe4e8fea tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.523657 Jul 21 10:49:18.155552 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 176/352] 10.222.0.48 () {60 vars in 1158 bytes} [Thu Jul 21 10:49:17 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:49:18.431408 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-da930641-7ca7-4ea8-909f-294b4c991e4e tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:49:18.432116 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-da930641-7ca7-4ea8-909f-294b4c991e4e tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:49:18.440354 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-da930641-7ca7-4ea8-909f-294b4c991e4e tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:18.441359 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-da930641-7ca7-4ea8-909f-294b4c991e4e tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:18.442754 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-da930641-7ca7-4ea8-909f-294b4c991e4e tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:18.443447 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-da930641-7ca7-4ea8-909f-294b4c991e4e tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:18.696248 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-da930641-7ca7-4ea8-909f-294b4c991e4e tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:18.716595 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-da930641-7ca7-4ea8-909f-294b4c991e4e tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:18.724909 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-da930641-7ca7-4ea8-909f-294b4c991e4e tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:18.727126 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-da930641-7ca7-4ea8-909f-294b4c991e4e tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1739 microversion: 2.20 time: 0.300212 Jul 21 10:49:18.741856 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 177/353] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:49:18 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1739 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:49:18.812306 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-84d63181-6bf7-4d51-a80b-31dbd1150361 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:49:18.813550 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-84d63181-6bf7-4d51-a80b-31dbd1150361 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:49:18.828506 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-84d63181-6bf7-4d51-a80b-31dbd1150361 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:18.829269 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-84d63181-6bf7-4d51-a80b-31dbd1150361 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:18.830459 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-84d63181-6bf7-4d51-a80b-31dbd1150361 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:18.830940 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-84d63181-6bf7-4d51-a80b-31dbd1150361 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:18.942011 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-84d63181-6bf7-4d51-a80b-31dbd1150361 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906e4bc4e9cc45ecb01cfca7918e461d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc215aadb5345d791945658832aae4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:18.951196 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-84d63181-6bf7-4d51-a80b-31dbd1150361 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b" status: 200 len: 1292 microversion: 2.1 time: 0.143850 Jul 21 10:49:18.972737 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 177/354] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:49:18 2022] GET /compute/v2.1/servers/73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b => generated 1292 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:49:19.748980 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-f083082b-41d3-438b-8142-63d80377df9b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:49:19.748980 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-f083082b-41d3-438b-8142-63d80377df9b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:49:19.785790 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f083082b-41d3-438b-8142-63d80377df9b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:19.787058 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f083082b-41d3-438b-8142-63d80377df9b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:19.788616 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f083082b-41d3-438b-8142-63d80377df9b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:19.789330 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f083082b-41d3-438b-8142-63d80377df9b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:19.973328 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-70bed562-236a-4ce0-aa69-2bcf4c6e1daf tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:49:19.974393 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-70bed562-236a-4ce0-aa69-2bcf4c6e1daf tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:49:19.988018 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-70bed562-236a-4ce0-aa69-2bcf4c6e1daf tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:19.990846 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-70bed562-236a-4ce0-aa69-2bcf4c6e1daf tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:19.992067 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-70bed562-236a-4ce0-aa69-2bcf4c6e1daf tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:19.994104 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-70bed562-236a-4ce0-aa69-2bcf4c6e1daf tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:20.031690 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-f083082b-41d3-438b-8142-63d80377df9b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:20.047243 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-f083082b-41d3-438b-8142-63d80377df9b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:20.048909 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-f083082b-41d3-438b-8142-63d80377df9b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:20.052806 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-f083082b-41d3-438b-8142-63d80377df9b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1739 microversion: 2.20 time: 0.309936 Jul 21 10:49:20.054917 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 178/355] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:49:19 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1739 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:49:20.118796 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-70bed562-236a-4ce0-aa69-2bcf4c6e1daf tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906e4bc4e9cc45ecb01cfca7918e461d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc215aadb5345d791945658832aae4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:20.129394 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-70bed562-236a-4ce0-aa69-2bcf4c6e1daf tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b" status: 200 len: 1298 microversion: 2.1 time: 0.163505 Jul 21 10:49:20.131645 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 178/356] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:49:19 2022] GET /compute/v2.1/servers/73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b => generated 1298 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:49:21.079462 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-29105c0e-282c-4481-bf8f-cd6e2caed7ca tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:49:21.080079 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-29105c0e-282c-4481-bf8f-cd6e2caed7ca tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:49:21.101094 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-29105c0e-282c-4481-bf8f-cd6e2caed7ca tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:21.101547 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-29105c0e-282c-4481-bf8f-cd6e2caed7ca tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:21.102329 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-29105c0e-282c-4481-bf8f-cd6e2caed7ca tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:21.102800 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-29105c0e-282c-4481-bf8f-cd6e2caed7ca tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:21.153960 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-67a60211-6e8c-41ef-b860-198cf78a97cb tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:49:21.170130 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-67a60211-6e8c-41ef-b860-198cf78a97cb tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:49:21.201082 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-67a60211-6e8c-41ef-b860-198cf78a97cb tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:21.212773 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-67a60211-6e8c-41ef-b860-198cf78a97cb tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:21.216520 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-67a60211-6e8c-41ef-b860-198cf78a97cb tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:21.217528 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-67a60211-6e8c-41ef-b860-198cf78a97cb tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:21.491372 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-29105c0e-282c-4481-bf8f-cd6e2caed7ca tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:21.503855 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-29105c0e-282c-4481-bf8f-cd6e2caed7ca tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:21.510679 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-29105c0e-282c-4481-bf8f-cd6e2caed7ca tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:21.513058 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-29105c0e-282c-4481-bf8f-cd6e2caed7ca tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1739 microversion: 2.20 time: 0.442744 Jul 21 10:49:21.515986 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 179/357] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:49:21 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1739 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:49:21.601834 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-67a60211-6e8c-41ef-b860-198cf78a97cb tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906e4bc4e9cc45ecb01cfca7918e461d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc215aadb5345d791945658832aae4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:21.614623 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-67a60211-6e8c-41ef-b860-198cf78a97cb tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b" status: 200 len: 1366 microversion: 2.1 time: 0.465947 Jul 21 10:49:21.617351 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 179/358] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:49:21 2022] GET /compute/v2.1/servers/73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b => generated 1366 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:49:22.537783 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-c65530f8-e367-41f8-a02d-ca4b6fc426ad tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:49:22.537783 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-c65530f8-e367-41f8-a02d-ca4b6fc426ad tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:49:22.541874 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c65530f8-e367-41f8-a02d-ca4b6fc426ad tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:22.542780 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c65530f8-e367-41f8-a02d-ca4b6fc426ad tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:22.550197 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c65530f8-e367-41f8-a02d-ca4b6fc426ad tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:22.551036 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c65530f8-e367-41f8-a02d-ca4b6fc426ad tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:22.640407 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-5a6efd39-9b52-494b-aba3-994fddbe608f tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:49:22.642247 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-5a6efd39-9b52-494b-aba3-994fddbe608f tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:49:22.650232 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=4 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:49:22.662164 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5a6efd39-9b52-494b-aba3-994fddbe608f tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:22.663524 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5a6efd39-9b52-494b-aba3-994fddbe608f tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:22.664766 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5a6efd39-9b52-494b-aba3-994fddbe608f tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:22.665431 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5a6efd39-9b52-494b-aba3-994fddbe608f tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:22.897949 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-c65530f8-e367-41f8-a02d-ca4b6fc426ad tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:22.911232 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-c65530f8-e367-41f8-a02d-ca4b6fc426ad tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:22.914173 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-c65530f8-e367-41f8-a02d-ca4b6fc426ad tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:22.919520 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-c65530f8-e367-41f8-a02d-ca4b6fc426ad tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1739 microversion: 2.20 time: 0.390820 Jul 21 10:49:22.932900 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 180/359] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:49:22 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1739 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:49:23.023108 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-5a6efd39-9b52-494b-aba3-994fddbe608f tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906e4bc4e9cc45ecb01cfca7918e461d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc215aadb5345d791945658832aae4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:23.037366 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-5a6efd39-9b52-494b-aba3-994fddbe608f tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b" status: 200 len: 1366 microversion: 2.1 time: 0.403988 Jul 21 10:49:23.038500 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 180/360] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:49:22 2022] GET /compute/v2.1/servers/73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b => generated 1366 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:49:23.942810 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-b2345e9f-2004-4cb7-8106-241f3896bce2 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:49:23.943841 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-b2345e9f-2004-4cb7-8106-241f3896bce2 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:49:23.960472 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b2345e9f-2004-4cb7-8106-241f3896bce2 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:23.962871 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b2345e9f-2004-4cb7-8106-241f3896bce2 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:23.963834 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b2345e9f-2004-4cb7-8106-241f3896bce2 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:23.965378 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b2345e9f-2004-4cb7-8106-241f3896bce2 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:24.057300 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-c6005916-96ce-46fc-8891-a04ba31646fa tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:49:24.058121 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-c6005916-96ce-46fc-8891-a04ba31646fa tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:49:24.075437 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c6005916-96ce-46fc-8891-a04ba31646fa tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:24.084710 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c6005916-96ce-46fc-8891-a04ba31646fa tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:24.084710 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c6005916-96ce-46fc-8891-a04ba31646fa tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:24.084710 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c6005916-96ce-46fc-8891-a04ba31646fa tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:24.359741 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-b2345e9f-2004-4cb7-8106-241f3896bce2 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:24.375359 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-b2345e9f-2004-4cb7-8106-241f3896bce2 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:24.396336 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-b2345e9f-2004-4cb7-8106-241f3896bce2 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:24.398194 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-b2345e9f-2004-4cb7-8106-241f3896bce2 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1739 microversion: 2.20 time: 0.461267 Jul 21 10:49:24.413489 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 181/361] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:49:23 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1739 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:49:24.446441 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [req-3427be80-d875-4ef6-819a-49914d99a92b req-ad39380b-2899-49de-9fd7-10a30eb7bb2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b", "tag": "a13ed13b-8d67-46d9-a44b-a3230486e080"}]} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:49:24.479603 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-3427be80-d875-4ef6-819a-49914d99a92b req-ad39380b-2899-49de-9fd7-10a30eb7bb2d service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:24.480056 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-3427be80-d875-4ef6-819a-49914d99a92b req-ad39380b-2899-49de-9fd7-10a30eb7bb2d service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:24.531865 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.compute.server_external_events [req-3427be80-d875-4ef6-819a-49914d99a92b req-ad39380b-2899-49de-9fd7-10a30eb7bb2d service nova] Creating event network-changed:a13ed13b-8d67-46d9-a44b-a3230486e080 for instance 73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b on hv-cinder-84980 Jul 21 10:49:24.542117 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [req-3427be80-d875-4ef6-819a-49914d99a92b req-ad39380b-2899-49de-9fd7-10a30eb7bb2d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129136 Jul 21 10:49:24.545075 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 182/362] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 21 10:49:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:49:24.570064 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-c6005916-96ce-46fc-8891-a04ba31646fa tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906e4bc4e9cc45ecb01cfca7918e461d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc215aadb5345d791945658832aae4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:24.580006 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-c6005916-96ce-46fc-8891-a04ba31646fa tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b" status: 200 len: 1366 microversion: 2.1 time: 0.527593 Jul 21 10:49:24.581111 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 181/363] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:49:24 2022] GET /compute/v2.1/servers/73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b => generated 1366 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:49:25.434715 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-5069f20c-9c7e-418f-827c-e89e2d69fcf1 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:49:25.435415 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-5069f20c-9c7e-418f-827c-e89e2d69fcf1 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:49:25.450125 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5069f20c-9c7e-418f-827c-e89e2d69fcf1 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:25.450833 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5069f20c-9c7e-418f-827c-e89e2d69fcf1 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:25.452054 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5069f20c-9c7e-418f-827c-e89e2d69fcf1 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:25.452709 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5069f20c-9c7e-418f-827c-e89e2d69fcf1 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:25.597363 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-9e462911-1b0d-4874-9681-6167c526636d tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:49:25.598845 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-9e462911-1b0d-4874-9681-6167c526636d tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:49:25.608256 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9e462911-1b0d-4874-9681-6167c526636d tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:25.613728 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9e462911-1b0d-4874-9681-6167c526636d tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:25.615160 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9e462911-1b0d-4874-9681-6167c526636d tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:25.616483 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9e462911-1b0d-4874-9681-6167c526636d tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:26.096914 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-5069f20c-9c7e-418f-827c-e89e2d69fcf1 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:26.112321 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-5069f20c-9c7e-418f-827c-e89e2d69fcf1 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:26.116968 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-5069f20c-9c7e-418f-827c-e89e2d69fcf1 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:26.118299 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-5069f20c-9c7e-418f-827c-e89e2d69fcf1 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1739 microversion: 2.20 time: 0.691241 Jul 21 10:49:26.119630 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 183/364] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:49:25 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1739 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:49:26.132818 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell0:SELECT=2 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:49:26.205767 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-9e462911-1b0d-4874-9681-6167c526636d tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906e4bc4e9cc45ecb01cfca7918e461d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc215aadb5345d791945658832aae4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:26.214108 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-9e462911-1b0d-4874-9681-6167c526636d tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b" status: 200 len: 1366 microversion: 2.1 time: 0.621119 Jul 21 10:49:26.220536 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 182/365] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:49:25 2022] GET /compute/v2.1/servers/73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b => generated 1366 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:49:27.149729 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-f9eb9b61-cd50-4b68-8c4a-c2621f17554a tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:49:27.152874 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-f9eb9b61-cd50-4b68-8c4a-c2621f17554a tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:49:27.176418 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f9eb9b61-cd50-4b68-8c4a-c2621f17554a tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:27.177258 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f9eb9b61-cd50-4b68-8c4a-c2621f17554a tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:27.178288 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f9eb9b61-cd50-4b68-8c4a-c2621f17554a tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:27.179797 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f9eb9b61-cd50-4b68-8c4a-c2621f17554a tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:27.238845 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-2003949d-f1d2-4abe-b37c-76b0faeef518 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:49:27.241061 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-2003949d-f1d2-4abe-b37c-76b0faeef518 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:49:27.254082 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2003949d-f1d2-4abe-b37c-76b0faeef518 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:27.254984 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2003949d-f1d2-4abe-b37c-76b0faeef518 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:27.255999 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2003949d-f1d2-4abe-b37c-76b0faeef518 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:27.256653 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2003949d-f1d2-4abe-b37c-76b0faeef518 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:27.550066 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-f9eb9b61-cd50-4b68-8c4a-c2621f17554a tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:27.558020 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-2003949d-f1d2-4abe-b37c-76b0faeef518 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906e4bc4e9cc45ecb01cfca7918e461d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc215aadb5345d791945658832aae4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:27.567652 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-2003949d-f1d2-4abe-b37c-76b0faeef518 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b" status: 200 len: 1366 microversion: 2.1 time: 0.334061 Jul 21 10:49:27.568832 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 183/366] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:49:27 2022] GET /compute/v2.1/servers/73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b => generated 1366 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:49:27.570712 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-f9eb9b61-cd50-4b68-8c4a-c2621f17554a tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:27.572580 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-f9eb9b61-cd50-4b68-8c4a-c2621f17554a tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:27.573926 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-f9eb9b61-cd50-4b68-8c4a-c2621f17554a tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1739 microversion: 2.20 time: 0.439824 Jul 21 10:49:27.575271 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 184/367] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:49:27 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1739 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:49:28.604385 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-473f74b4-dc57-44a6-97dd-e1664c0f29ed tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:49:28.606205 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-52ea9bf7-b43b-4350-8ef3-c575ae1133cf tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:49:28.607257 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-473f74b4-dc57-44a6-97dd-e1664c0f29ed tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:49:28.612283 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-52ea9bf7-b43b-4350-8ef3-c575ae1133cf tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:49:28.616610 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell0:SELECT=10 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:49:28.638935 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell0:SELECT=8 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:49:28.651020 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-473f74b4-dc57-44a6-97dd-e1664c0f29ed tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:28.655874 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-52ea9bf7-b43b-4350-8ef3-c575ae1133cf tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:28.656762 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-52ea9bf7-b43b-4350-8ef3-c575ae1133cf tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:28.658450 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-473f74b4-dc57-44a6-97dd-e1664c0f29ed tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:28.659857 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-473f74b4-dc57-44a6-97dd-e1664c0f29ed tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:28.659988 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-52ea9bf7-b43b-4350-8ef3-c575ae1133cf tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:28.660430 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-52ea9bf7-b43b-4350-8ef3-c575ae1133cf tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:28.660571 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-473f74b4-dc57-44a6-97dd-e1664c0f29ed tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:29.027958 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-52ea9bf7-b43b-4350-8ef3-c575ae1133cf tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906e4bc4e9cc45ecb01cfca7918e461d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc215aadb5345d791945658832aae4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:29.056181 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-52ea9bf7-b43b-4350-8ef3-c575ae1133cf tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b" status: 200 len: 1366 microversion: 2.1 time: 0.460097 Jul 21 10:49:29.056837 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 184/368] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:49:28 2022] GET /compute/v2.1/servers/73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b => generated 1366 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:49:29.187785 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-473f74b4-dc57-44a6-97dd-e1664c0f29ed tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:29.198486 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-473f74b4-dc57-44a6-97dd-e1664c0f29ed tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:29.201563 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-473f74b4-dc57-44a6-97dd-e1664c0f29ed tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:29.202842 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-473f74b4-dc57-44a6-97dd-e1664c0f29ed tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1739 microversion: 2.20 time: 0.613003 Jul 21 10:49:29.203784 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 185/369] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:49:28 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1739 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:49:30.077841 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-e95124aa-273e-43a5-a26c-f2b243d2c040 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:49:30.078500 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-e95124aa-273e-43a5-a26c-f2b243d2c040 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:49:30.090494 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e95124aa-273e-43a5-a26c-f2b243d2c040 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:30.090985 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e95124aa-273e-43a5-a26c-f2b243d2c040 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:30.091767 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e95124aa-273e-43a5-a26c-f2b243d2c040 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:30.092377 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e95124aa-273e-43a5-a26c-f2b243d2c040 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:30.224678 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-4cc8491a-2f3b-480e-a222-24be50a69bef tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:49:30.225864 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-4cc8491a-2f3b-480e-a222-24be50a69bef tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:49:30.236741 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4cc8491a-2f3b-480e-a222-24be50a69bef tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:30.237428 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4cc8491a-2f3b-480e-a222-24be50a69bef tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:30.249177 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4cc8491a-2f3b-480e-a222-24be50a69bef tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:30.253369 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4cc8491a-2f3b-480e-a222-24be50a69bef tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:30.304683 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:49:30.328095 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-e95124aa-273e-43a5-a26c-f2b243d2c040 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906e4bc4e9cc45ecb01cfca7918e461d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc215aadb5345d791945658832aae4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:30.338578 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-e95124aa-273e-43a5-a26c-f2b243d2c040 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b" status: 200 len: 1366 microversion: 2.1 time: 0.266300 Jul 21 10:49:30.342312 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 185/370] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:49:30 2022] GET /compute/v2.1/servers/73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b => generated 1366 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:49:30.473215 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-4cc8491a-2f3b-480e-a222-24be50a69bef tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:30.481811 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-4cc8491a-2f3b-480e-a222-24be50a69bef tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:30.483477 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-4cc8491a-2f3b-480e-a222-24be50a69bef tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:30.488112 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-4cc8491a-2f3b-480e-a222-24be50a69bef tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1739 microversion: 2.20 time: 0.267141 Jul 21 10:49:30.488904 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 186/371] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:49:30 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1739 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 10:49:31.359240 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-8ddb8c55-ca53-4b97-a928-fd0c1dbf0efb tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:49:31.360561 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-8ddb8c55-ca53-4b97-a928-fd0c1dbf0efb tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:49:31.390416 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8ddb8c55-ca53-4b97-a928-fd0c1dbf0efb tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:31.390898 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8ddb8c55-ca53-4b97-a928-fd0c1dbf0efb tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:31.391671 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8ddb8c55-ca53-4b97-a928-fd0c1dbf0efb tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:31.392106 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8ddb8c55-ca53-4b97-a928-fd0c1dbf0efb tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:31.507711 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-f19820ce-674d-417f-8dd1-1d853fa15ccf tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:49:31.508659 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-f19820ce-674d-417f-8dd1-1d853fa15ccf tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:49:31.511229 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=1 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:49:31.519473 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f19820ce-674d-417f-8dd1-1d853fa15ccf tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:31.520028 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f19820ce-674d-417f-8dd1-1d853fa15ccf tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:31.521556 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f19820ce-674d-417f-8dd1-1d853fa15ccf tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:31.522103 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f19820ce-674d-417f-8dd1-1d853fa15ccf tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:31.591066 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-8ddb8c55-ca53-4b97-a928-fd0c1dbf0efb tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906e4bc4e9cc45ecb01cfca7918e461d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc215aadb5345d791945658832aae4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:31.606371 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-8ddb8c55-ca53-4b97-a928-fd0c1dbf0efb tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b" status: 200 len: 1366 microversion: 2.1 time: 0.250931 Jul 21 10:49:31.618010 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 186/372] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:49:31 2022] GET /compute/v2.1/servers/73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b => generated 1366 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:49:31.720149 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-f19820ce-674d-417f-8dd1-1d853fa15ccf tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:31.728109 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-f19820ce-674d-417f-8dd1-1d853fa15ccf tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:31.740446 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-f19820ce-674d-417f-8dd1-1d853fa15ccf tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:31.742059 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-f19820ce-674d-417f-8dd1-1d853fa15ccf tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1721 microversion: 2.20 time: 0.239205 Jul 21 10:49:31.754158 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 187/373] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:49:31 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1721 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:49:32.631403 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-b0cc9e16-4de2-46c2-be74-f6d550527d35 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:49:32.632350 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-b0cc9e16-4de2-46c2-be74-f6d550527d35 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:49:32.642926 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b0cc9e16-4de2-46c2-be74-f6d550527d35 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:32.661844 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b0cc9e16-4de2-46c2-be74-f6d550527d35 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:32.664090 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b0cc9e16-4de2-46c2-be74-f6d550527d35 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:32.664547 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b0cc9e16-4de2-46c2-be74-f6d550527d35 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:32.668333 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell1:SELECT=100 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:49:32.768845 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-9342e928-e4c3-40ac-b075-59a20ad9bc12 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:49:32.769984 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-9342e928-e4c3-40ac-b075-59a20ad9bc12 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:49:32.788756 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9342e928-e4c3-40ac-b075-59a20ad9bc12 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:32.791979 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9342e928-e4c3-40ac-b075-59a20ad9bc12 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:32.794502 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9342e928-e4c3-40ac-b075-59a20ad9bc12 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:32.795146 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9342e928-e4c3-40ac-b075-59a20ad9bc12 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:32.839031 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-b0cc9e16-4de2-46c2-be74-f6d550527d35 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906e4bc4e9cc45ecb01cfca7918e461d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc215aadb5345d791945658832aae4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:32.849060 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-b0cc9e16-4de2-46c2-be74-f6d550527d35 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b" status: 200 len: 1366 microversion: 2.1 time: 0.227966 Jul 21 10:49:32.850269 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 187/374] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:49:32 2022] GET /compute/v2.1/servers/73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b => generated 1366 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:49:32.967130 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-9342e928-e4c3-40ac-b075-59a20ad9bc12 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:32.978789 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-9342e928-e4c3-40ac-b075-59a20ad9bc12 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:32.982297 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-9342e928-e4c3-40ac-b075-59a20ad9bc12 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:32.983901 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-9342e928-e4c3-40ac-b075-59a20ad9bc12 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1721 microversion: 2.20 time: 0.219639 Jul 21 10:49:32.984997 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 188/375] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:49:32 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1721 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:49:33.868435 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-de8c903c-3dd0-4e80-959a-9fd783351042 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:49:33.869042 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-de8c903c-3dd0-4e80-959a-9fd783351042 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:49:33.875882 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-de8c903c-3dd0-4e80-959a-9fd783351042 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:33.876333 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-de8c903c-3dd0-4e80-959a-9fd783351042 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:33.877097 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-de8c903c-3dd0-4e80-959a-9fd783351042 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:33.877535 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-de8c903c-3dd0-4e80-959a-9fd783351042 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:34.006289 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-efc45e42-1e4f-4912-b416-4182affa87e3 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:49:34.007164 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-efc45e42-1e4f-4912-b416-4182affa87e3 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:49:34.020932 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-efc45e42-1e4f-4912-b416-4182affa87e3 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:34.020932 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-efc45e42-1e4f-4912-b416-4182affa87e3 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:34.020932 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-efc45e42-1e4f-4912-b416-4182affa87e3 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:34.020932 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-efc45e42-1e4f-4912-b416-4182affa87e3 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:34.044279 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-de8c903c-3dd0-4e80-959a-9fd783351042 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906e4bc4e9cc45ecb01cfca7918e461d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc215aadb5345d791945658832aae4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:34.060154 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-de8c903c-3dd0-4e80-959a-9fd783351042 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b" status: 200 len: 1366 microversion: 2.1 time: 0.195370 Jul 21 10:49:34.061007 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 188/376] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:49:33 2022] GET /compute/v2.1/servers/73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b => generated 1366 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:49:34.241209 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-efc45e42-1e4f-4912-b416-4182affa87e3 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:34.250642 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-efc45e42-1e4f-4912-b416-4182affa87e3 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:34.252387 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-efc45e42-1e4f-4912-b416-4182affa87e3 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:34.253796 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-efc45e42-1e4f-4912-b416-4182affa87e3 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1721 microversion: 2.20 time: 0.254273 Jul 21 10:49:34.263964 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 189/377] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:49:33 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1721 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:49:35.086584 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-40578c10-0be1-4153-88e3-c5a0ce116751 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:49:35.098583 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-40578c10-0be1-4153-88e3-c5a0ce116751 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:49:35.102878 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-40578c10-0be1-4153-88e3-c5a0ce116751 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:35.103570 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-40578c10-0be1-4153-88e3-c5a0ce116751 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:35.104840 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-40578c10-0be1-4153-88e3-c5a0ce116751 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:35.105408 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-40578c10-0be1-4153-88e3-c5a0ce116751 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:35.151074 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [req-adb3b806-5eb2-41a1-85fc-c75e494ad375 req-1344fffd-e5b8-496c-8ecc-832c2c144720 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e730525-7ce4-4a5a-8023-84cae6b1da3d", "name": "network-vif-unplugged", "status": "completed", "tag": "e0efd748-6569-4435-ab16-d9acccb72164"}]} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:49:35.179518 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-adb3b806-5eb2-41a1-85fc-c75e494ad375 req-1344fffd-e5b8-496c-8ecc-832c2c144720 service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:35.180246 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-adb3b806-5eb2-41a1-85fc-c75e494ad375 req-1344fffd-e5b8-496c-8ecc-832c2c144720 service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:35.207888 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.compute.server_external_events [req-adb3b806-5eb2-41a1-85fc-c75e494ad375 req-1344fffd-e5b8-496c-8ecc-832c2c144720 service nova] Creating event network-vif-unplugged:e0efd748-6569-4435-ab16-d9acccb72164 for instance 1e730525-7ce4-4a5a-8023-84cae6b1da3d on hv-cinder-84980 Jul 21 10:49:35.213696 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [req-adb3b806-5eb2-41a1-85fc-c75e494ad375 req-1344fffd-e5b8-496c-8ecc-832c2c144720 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.066732 Jul 21 10:49:35.215177 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 190/378] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 21 10:49:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 10:49:35.273033 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-c61466e3-f738-4592-95ab-a72e271d8f85 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:49:35.273955 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-c61466e3-f738-4592-95ab-a72e271d8f85 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:49:35.281567 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c61466e3-f738-4592-95ab-a72e271d8f85 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:35.282016 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c61466e3-f738-4592-95ab-a72e271d8f85 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:35.283018 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c61466e3-f738-4592-95ab-a72e271d8f85 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:35.283457 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c61466e3-f738-4592-95ab-a72e271d8f85 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:35.311840 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-40578c10-0be1-4153-88e3-c5a0ce116751 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906e4bc4e9cc45ecb01cfca7918e461d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc215aadb5345d791945658832aae4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:35.320140 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-40578c10-0be1-4153-88e3-c5a0ce116751 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b" status: 200 len: 1366 microversion: 2.1 time: 0.240379 Jul 21 10:49:35.331309 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 189/379] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:49:35 2022] GET /compute/v2.1/servers/73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b => generated 1366 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:49:35.485153 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-c61466e3-f738-4592-95ab-a72e271d8f85 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:35.498741 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-c61466e3-f738-4592-95ab-a72e271d8f85 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:35.500348 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-c61466e3-f738-4592-95ab-a72e271d8f85 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:35.501684 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-c61466e3-f738-4592-95ab-a72e271d8f85 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1721 microversion: 2.20 time: 0.233052 Jul 21 10:49:35.513756 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 191/380] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:49:35 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1721 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:49:36.338085 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-83a5d644-80ec-4501-9f66-f8b25fb3b498 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:49:36.339315 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-83a5d644-80ec-4501-9f66-f8b25fb3b498 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:49:36.346003 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-83a5d644-80ec-4501-9f66-f8b25fb3b498 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:36.346453 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-83a5d644-80ec-4501-9f66-f8b25fb3b498 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:36.347251 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-83a5d644-80ec-4501-9f66-f8b25fb3b498 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:36.347864 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-83a5d644-80ec-4501-9f66-f8b25fb3b498 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:36.503674 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-83a5d644-80ec-4501-9f66-f8b25fb3b498 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906e4bc4e9cc45ecb01cfca7918e461d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc215aadb5345d791945658832aae4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:36.521588 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-8a789cbf-6f26-4ea5-8e07-24c18f166d3f tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:49:36.522310 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-8a789cbf-6f26-4ea5-8e07-24c18f166d3f tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:49:36.530039 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-83a5d644-80ec-4501-9f66-f8b25fb3b498 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b" status: 200 len: 1366 microversion: 2.1 time: 0.195963 Jul 21 10:49:36.533123 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 190/381] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:49:36 2022] GET /compute/v2.1/servers/73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b => generated 1366 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:49:36.534322 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8a789cbf-6f26-4ea5-8e07-24c18f166d3f tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:36.535235 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8a789cbf-6f26-4ea5-8e07-24c18f166d3f tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:36.535778 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8a789cbf-6f26-4ea5-8e07-24c18f166d3f tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:36.536309 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8a789cbf-6f26-4ea5-8e07-24c18f166d3f tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:36.727208 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-8a789cbf-6f26-4ea5-8e07-24c18f166d3f tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:36.735848 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-8a789cbf-6f26-4ea5-8e07-24c18f166d3f tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:36.737403 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-8a789cbf-6f26-4ea5-8e07-24c18f166d3f tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:36.739384 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-8a789cbf-6f26-4ea5-8e07-24c18f166d3f tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1721 microversion: 2.20 time: 0.222588 Jul 21 10:49:36.739881 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 192/382] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:49:36 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1721 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 10:49:37.549355 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-59c227cc-5710-496a-8fa2-180b58c6b583 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:49:37.550747 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-59c227cc-5710-496a-8fa2-180b58c6b583 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:49:37.557698 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-59c227cc-5710-496a-8fa2-180b58c6b583 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:37.559347 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-59c227cc-5710-496a-8fa2-180b58c6b583 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:37.560441 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-59c227cc-5710-496a-8fa2-180b58c6b583 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:37.561106 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-59c227cc-5710-496a-8fa2-180b58c6b583 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:37.741404 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-59c227cc-5710-496a-8fa2-180b58c6b583 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906e4bc4e9cc45ecb01cfca7918e461d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc215aadb5345d791945658832aae4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:37.750873 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-59c227cc-5710-496a-8fa2-180b58c6b583 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b" status: 200 len: 1366 microversion: 2.1 time: 0.206224 Jul 21 10:49:37.751781 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 191/383] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:49:37 2022] GET /compute/v2.1/servers/73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b => generated 1366 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:49:37.757403 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-86af3eb9-7e64-4ec8-988c-215ecc69d27e tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:49:37.758504 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-86af3eb9-7e64-4ec8-988c-215ecc69d27e tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:49:37.765198 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-86af3eb9-7e64-4ec8-988c-215ecc69d27e tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:37.768526 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-86af3eb9-7e64-4ec8-988c-215ecc69d27e tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:37.769589 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-86af3eb9-7e64-4ec8-988c-215ecc69d27e tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:37.770024 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-86af3eb9-7e64-4ec8-988c-215ecc69d27e tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:37.918324 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-86af3eb9-7e64-4ec8-988c-215ecc69d27e tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:37.926920 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-86af3eb9-7e64-4ec8-988c-215ecc69d27e tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:37.928426 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-86af3eb9-7e64-4ec8-988c-215ecc69d27e tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:37.929635 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-86af3eb9-7e64-4ec8-988c-215ecc69d27e tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1721 microversion: 2.20 time: 0.176333 Jul 21 10:49:37.930188 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 193/384] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:49:37 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1721 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:49:38.768989 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-f81e2f6e-7bfe-4079-bce9-47d41e4fa367 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:49:38.769615 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-f81e2f6e-7bfe-4079-bce9-47d41e4fa367 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:49:38.776000 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [req-665c9ffc-f26a-4fb2-ac0d-d2aec41ba330 req-08e9744d-5c98-4649-99b7-308bfc980d94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b", "name": "network-vif-plugged", "status": "completed", "tag": "a13ed13b-8d67-46d9-a44b-a3230486e080"}]} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:49:38.778372 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f81e2f6e-7bfe-4079-bce9-47d41e4fa367 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:38.778853 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f81e2f6e-7bfe-4079-bce9-47d41e4fa367 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:38.779674 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f81e2f6e-7bfe-4079-bce9-47d41e4fa367 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:38.780120 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f81e2f6e-7bfe-4079-bce9-47d41e4fa367 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:38.793095 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-665c9ffc-f26a-4fb2-ac0d-d2aec41ba330 req-08e9744d-5c98-4649-99b7-308bfc980d94 service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:38.793823 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-665c9ffc-f26a-4fb2-ac0d-d2aec41ba330 req-08e9744d-5c98-4649-99b7-308bfc980d94 service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:38.813338 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.compute.server_external_events [req-665c9ffc-f26a-4fb2-ac0d-d2aec41ba330 req-08e9744d-5c98-4649-99b7-308bfc980d94 service nova] Creating event network-vif-plugged:a13ed13b-8d67-46d9-a44b-a3230486e080 for instance 73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b on hv-cinder-84980 Jul 21 10:49:38.823260 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [req-665c9ffc-f26a-4fb2-ac0d-d2aec41ba330 req-08e9744d-5c98-4649-99b7-308bfc980d94 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050788 Jul 21 10:49:38.824920 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 194/385] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 21 10:49:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:49:38.960310 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-d0364029-b1d3-4785-8948-a8a2ab0adcf5 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:49:38.961139 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-d0364029-b1d3-4785-8948-a8a2ab0adcf5 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:49:38.979770 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d0364029-b1d3-4785-8948-a8a2ab0adcf5 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:38.985206 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d0364029-b1d3-4785-8948-a8a2ab0adcf5 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:38.990339 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d0364029-b1d3-4785-8948-a8a2ab0adcf5 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:38.992629 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d0364029-b1d3-4785-8948-a8a2ab0adcf5 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:39.009497 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-f81e2f6e-7bfe-4079-bce9-47d41e4fa367 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906e4bc4e9cc45ecb01cfca7918e461d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc215aadb5345d791945658832aae4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:39.021931 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-f81e2f6e-7bfe-4079-bce9-47d41e4fa367 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b" status: 200 len: 1366 microversion: 2.1 time: 0.257288 Jul 21 10:49:39.023246 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 192/386] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:49:38 2022] GET /compute/v2.1/servers/73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b => generated 1366 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:49:39.191016 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-d0364029-b1d3-4785-8948-a8a2ab0adcf5 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:39.203604 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-d0364029-b1d3-4785-8948-a8a2ab0adcf5 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:39.205176 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-d0364029-b1d3-4785-8948-a8a2ab0adcf5 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:39.206491 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-d0364029-b1d3-4785-8948-a8a2ab0adcf5 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1721 microversion: 2.20 time: 0.259657 Jul 21 10:49:39.207096 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 195/387] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:49:38 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1721 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 10:49:40.043688 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-f42b1bb4-d7c8-4be2-b5ec-6c3b9ee0d3dd tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:49:40.044750 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-f42b1bb4-d7c8-4be2-b5ec-6c3b9ee0d3dd tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:49:40.054584 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f42b1bb4-d7c8-4be2-b5ec-6c3b9ee0d3dd tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:40.054584 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f42b1bb4-d7c8-4be2-b5ec-6c3b9ee0d3dd tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:40.054584 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f42b1bb4-d7c8-4be2-b5ec-6c3b9ee0d3dd tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:40.054584 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f42b1bb4-d7c8-4be2-b5ec-6c3b9ee0d3dd tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:40.227300 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-50d27f91-a719-4244-aa69-6ec25cdabe4b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:49:40.228550 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-50d27f91-a719-4244-aa69-6ec25cdabe4b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:49:40.235992 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-50d27f91-a719-4244-aa69-6ec25cdabe4b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:40.236696 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-50d27f91-a719-4244-aa69-6ec25cdabe4b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:40.237630 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-50d27f91-a719-4244-aa69-6ec25cdabe4b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:40.238357 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-50d27f91-a719-4244-aa69-6ec25cdabe4b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:40.250884 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-f42b1bb4-d7c8-4be2-b5ec-6c3b9ee0d3dd tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906e4bc4e9cc45ecb01cfca7918e461d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc215aadb5345d791945658832aae4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:40.262456 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-f42b1bb4-d7c8-4be2-b5ec-6c3b9ee0d3dd tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b" status: 200 len: 1366 microversion: 2.1 time: 0.223686 Jul 21 10:49:40.271003 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 193/388] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:49:40 2022] GET /compute/v2.1/servers/73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b => generated 1366 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:49:40.444391 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-50d27f91-a719-4244-aa69-6ec25cdabe4b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:40.453608 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-50d27f91-a719-4244-aa69-6ec25cdabe4b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:40.459173 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-50d27f91-a719-4244-aa69-6ec25cdabe4b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:40.460859 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-50d27f91-a719-4244-aa69-6ec25cdabe4b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1721 microversion: 2.20 time: 0.237461 Jul 21 10:49:40.461935 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 196/389] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:49:40 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1721 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 10:49:41.279683 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-3a73fdf2-f357-4384-af3e-1dfa7ef425c9 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:49:41.281041 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-3a73fdf2-f357-4384-af3e-1dfa7ef425c9 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:49:41.290138 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3a73fdf2-f357-4384-af3e-1dfa7ef425c9 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:41.290943 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3a73fdf2-f357-4384-af3e-1dfa7ef425c9 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:41.297315 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3a73fdf2-f357-4384-af3e-1dfa7ef425c9 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:41.297315 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3a73fdf2-f357-4384-af3e-1dfa7ef425c9 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:41.480320 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-5226d87f-97b1-49a9-8c7c-865763156fc1 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:49:41.481252 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-5226d87f-97b1-49a9-8c7c-865763156fc1 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:49:41.493837 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5226d87f-97b1-49a9-8c7c-865763156fc1 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:41.496453 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5226d87f-97b1-49a9-8c7c-865763156fc1 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:41.502276 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5226d87f-97b1-49a9-8c7c-865763156fc1 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:41.502276 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5226d87f-97b1-49a9-8c7c-865763156fc1 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:41.565881 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-3a73fdf2-f357-4384-af3e-1dfa7ef425c9 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906e4bc4e9cc45ecb01cfca7918e461d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc215aadb5345d791945658832aae4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:41.578370 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-3a73fdf2-f357-4384-af3e-1dfa7ef425c9 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b" status: 200 len: 1366 microversion: 2.1 time: 0.300112 Jul 21 10:49:41.579448 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 194/390] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:49:41 2022] GET /compute/v2.1/servers/73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b => generated 1366 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:49:41.714155 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-5226d87f-97b1-49a9-8c7c-865763156fc1 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:41.727140 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-5226d87f-97b1-49a9-8c7c-865763156fc1 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:41.728778 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-5226d87f-97b1-49a9-8c7c-865763156fc1 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:41.730085 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-5226d87f-97b1-49a9-8c7c-865763156fc1 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1724 microversion: 2.20 time: 0.254042 Jul 21 10:49:41.735801 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 197/391] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:49:41 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1724 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 10:49:41.761179 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-b9b0eb76-3a4e-4fcc-a455-f403634c045f tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a0a9ba60-d84c-4c0e-be7b-734cae5ad94a"}} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:49:41.763027 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-b9b0eb76-3a4e-4fcc-a455-f403634c045f tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:49:41.770948 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b9b0eb76-3a4e-4fcc-a455-f403634c045f tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:41.771791 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b9b0eb76-3a4e-4fcc-a455-f403634c045f tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:41.772736 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b9b0eb76-3a4e-4fcc-a455-f403634c045f tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:41.773353 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b9b0eb76-3a4e-4fcc-a455-f403634c045f tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:42.001424 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-c8198f75-2a4a-40d7-9d45-2e15dd33be65 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-442158028", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1816234042", "security_groups": [{"name": "tempest-secgroup-smoke-2034104126"}], "networks": [{"uuid": "27b56899-b3ca-45d1-a202-b2681b2d043e"}], "block_device_mapping_v2": [{"uuid": "b612f7ff-b066-4345-b20a-8d88e7ff649c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:49:42.271555 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.network.neutron [None req-c8198f75-2a4a-40d7-9d45-2e15dd33be65 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] validate_networks() for [('27b56899-b3ca-45d1-a202-b2681b2d043e', None, None, None, None, None)] {{(pid=124868) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 10:49:42.826536 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.virt.hardware [None req-c8198f75-2a4a-40d7-9d45-2e15dd33be65 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Flavor limits 0:0:0 {{(pid=124868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 10:49:42.827206 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.virt.hardware [None req-c8198f75-2a4a-40d7-9d45-2e15dd33be65 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Image limits 0:0:0 {{(pid=124868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 10:49:42.827664 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.virt.hardware [None req-c8198f75-2a4a-40d7-9d45-2e15dd33be65 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Flavor pref 0:0:0 {{(pid=124868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 10:49:42.828165 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.virt.hardware [None req-c8198f75-2a4a-40d7-9d45-2e15dd33be65 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Image pref 0:0:0 {{(pid=124868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 10:49:42.828665 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.virt.hardware [None req-c8198f75-2a4a-40d7-9d45-2e15dd33be65 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 10:49:42.839047 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c8198f75-2a4a-40d7-9d45-2e15dd33be65 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:42.841155 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c8198f75-2a4a-40d7-9d45-2e15dd33be65 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:42.842327 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c8198f75-2a4a-40d7-9d45-2e15dd33be65 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:42.842940 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c8198f75-2a4a-40d7-9d45-2e15dd33be65 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:42.865110 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.quota [None req-c8198f75-2a4a-40d7-9d45-2e15dd33be65 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Getting quotas for project 620ea9c4eaa74dc5858cf93d9fcad9f1. Resources: {'ram', 'instances', 'cores'} {{(pid=124868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 10:49:42.870981 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.quota [None req-c8198f75-2a4a-40d7-9d45-2e15dd33be65 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Getting quotas for user e2e3fd195fd14b009ba56950dc542cb1 and project 620ea9c4eaa74dc5858cf93d9fcad9f1. Resources: {'ram', 'instances', 'cores'} {{(pid=124868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 10:49:42.946199 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-c8198f75-2a4a-40d7-9d45-2e15dd33be65 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Going to run 1 instances... {{(pid=124868) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 10:49:42.956388 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-c8198f75-2a4a-40d7-9d45-2e15dd33be65 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] [instance: eb24f843-eeb3-43dd-bd48-3bcf68e344cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b612f7ff-b066-4345-b20a-8d88e7ff649c',volume_size=None,volume_type=None)] {{(pid=124868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 10:49:43.035759 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-b9b0eb76-3a4e-4fcc-a455-f403634c045f tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "POST /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.280140 Jul 21 10:49:43.037356 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 195/392] 10.222.0.48 () {62 vars in 1363 bytes} [Thu Jul 21 10:49:41 2022] POST /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d/os-volume_attachments => generated 188 bytes in 1283 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 10:49:43.053779 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-8dcedb88-62c4-4a71-a043-e3602a441786 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:49:43.057049 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-8dcedb88-62c4-4a71-a043-e3602a441786 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:49:43.081932 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8dcedb88-62c4-4a71-a043-e3602a441786 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:43.088796 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8dcedb88-62c4-4a71-a043-e3602a441786 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:43.093360 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8dcedb88-62c4-4a71-a043-e3602a441786 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:43.093917 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8dcedb88-62c4-4a71-a043-e3602a441786 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:43.321034 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-8dcedb88-62c4-4a71-a043-e3602a441786 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906e4bc4e9cc45ecb01cfca7918e461d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc215aadb5345d791945658832aae4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:43.335392 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-8dcedb88-62c4-4a71-a043-e3602a441786 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b" status: 200 len: 1556 microversion: 2.1 time: 0.296767 Jul 21 10:49:43.352970 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 196/393] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:49:43 2022] GET /compute/v2.1/servers/73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b => generated 1556 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:49:43.359222 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-cab03d97-4f0d-43a0-8468-33966858c024 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:49:43.360102 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-cab03d97-4f0d-43a0-8468-33966858c024 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:49:43.368605 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-cab03d97-4f0d-43a0-8468-33966858c024 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:43.375837 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-cab03d97-4f0d-43a0-8468-33966858c024 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:43.375837 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-cab03d97-4f0d-43a0-8468-33966858c024 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:43.375837 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-cab03d97-4f0d-43a0-8468-33966858c024 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:43.475910 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c8198f75-2a4a-40d7-9d45-2e15dd33be65 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] [2ad77da2-a013-4982-8741-e29cb241d233] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 21 10:49:43.662037 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-cab03d97-4f0d-43a0-8468-33966858c024 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "POST /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d/action" status: 202 len: 0 microversion: 2.20 time: 0.307464 Jul 21 10:49:43.662671 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 197/394] 10.222.0.48 () {62 vars in 1318 bytes} [Thu Jul 21 10:49:43 2022] POST /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d/action => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 21 10:49:43.668575 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-c41a5ec4-a7ed-4136-98f7-35afde76a99f tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:49:43.669190 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-c41a5ec4-a7ed-4136-98f7-35afde76a99f tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:49:43.676810 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c41a5ec4-a7ed-4136-98f7-35afde76a99f tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:43.677253 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c41a5ec4-a7ed-4136-98f7-35afde76a99f tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:43.678084 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c41a5ec4-a7ed-4136-98f7-35afde76a99f tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:43.678822 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c41a5ec4-a7ed-4136-98f7-35afde76a99f tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:43.778108 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-c41a5ec4-a7ed-4136-98f7-35afde76a99f tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.113714 Jul 21 10:49:43.779422 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 198/395] 10.222.0.48 () {58 vars in 1274 bytes} [Thu Jul 21 10:49:43 2022] GET /compute/v2.1/servers/73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b/os-interface => generated 284 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:49:43.784551 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-9dc5d1cf-64a8-4b7d-ba63-953295cff1ca tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:49:43.785770 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-9dc5d1cf-64a8-4b7d-ba63-953295cff1ca tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:49:43.792523 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9dc5d1cf-64a8-4b7d-ba63-953295cff1ca tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:43.794327 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9dc5d1cf-64a8-4b7d-ba63-953295cff1ca tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:43.795370 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9dc5d1cf-64a8-4b7d-ba63-953295cff1ca tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:43.796006 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9dc5d1cf-64a8-4b7d-ba63-953295cff1ca tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:43.988957 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-9dc5d1cf-64a8-4b7d-ba63-953295cff1ca tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:43.998466 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-9dc5d1cf-64a8-4b7d-ba63-953295cff1ca tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:44.000020 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-9dc5d1cf-64a8-4b7d-ba63-953295cff1ca tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:44.001193 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-9dc5d1cf-64a8-4b7d-ba63-953295cff1ca tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1750 microversion: 2.20 time: 0.220651 Jul 21 10:49:44.002180 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 199/396] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:49:43 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1750 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:49:44.486047 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO oslo.messaging._drivers.impl_rabbit [None req-c8198f75-2a4a-40d7-9d45-2e15dd33be65 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] [2ad77da2-a013-4982-8741-e29cb241d233] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 33280. Jul 21 10:49:44.490827 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-c8198f75-2a4a-40d7-9d45-2e15dd33be65 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.493730 Jul 21 10:49:44.492092 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 198/397] 10.222.0.48 () {60 vars in 1146 bytes} [Thu Jul 21 10:49:41 2022] POST /compute/v2.1/servers => generated 406 bytes in 2496 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 10:49:44.502632 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-65d7f868-f1bd-4282-bbfa-a5fef25cacc7 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:49:44.503244 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-65d7f868-f1bd-4282-bbfa-a5fef25cacc7 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] [instance: eb24f843-eeb3-43dd-bd48-3bcf68e344cd] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:49:44.638770 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-65d7f868-f1bd-4282-bbfa-a5fef25cacc7 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e3fd195fd14b009ba56950dc542cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620ea9c4eaa74dc5858cf93d9fcad9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:44.646619 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-65d7f868-f1bd-4282-bbfa-a5fef25cacc7 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] 10.222.0.48 "GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd" status: 200 len: 1088 microversion: 2.1 time: 0.147775 Jul 21 10:49:44.647523 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 200/398] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:49:44 2022] GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd => generated 1088 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:49:45.020842 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-00dbc7e0-8af5-45f3-9e74-9c5ee2a574fc tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:49:45.021544 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-00dbc7e0-8af5-45f3-9e74-9c5ee2a574fc tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:49:45.031914 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-00dbc7e0-8af5-45f3-9e74-9c5ee2a574fc tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:45.032370 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-00dbc7e0-8af5-45f3-9e74-9c5ee2a574fc tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:45.036920 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-00dbc7e0-8af5-45f3-9e74-9c5ee2a574fc tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:45.042064 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-00dbc7e0-8af5-45f3-9e74-9c5ee2a574fc tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:45.223233 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-00dbc7e0-8af5-45f3-9e74-9c5ee2a574fc tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:45.232455 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-00dbc7e0-8af5-45f3-9e74-9c5ee2a574fc tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:45.234316 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-00dbc7e0-8af5-45f3-9e74-9c5ee2a574fc tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:45.235791 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-00dbc7e0-8af5-45f3-9e74-9c5ee2a574fc tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1750 microversion: 2.20 time: 0.219430 Jul 21 10:49:45.236345 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 199/399] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:49:45 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1750 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:49:45.570874 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [req-c1470f79-895d-4fd3-a7e4-89e9a9e3091a req-bcf713de-f577-4f71-8be5-e633ef378bc4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b", "tag": "a13ed13b-8d67-46d9-a44b-a3230486e080"}]} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:49:45.581331 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-c1470f79-895d-4fd3-a7e4-89e9a9e3091a req-bcf713de-f577-4f71-8be5-e633ef378bc4 service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:45.585971 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-c1470f79-895d-4fd3-a7e4-89e9a9e3091a req-bcf713de-f577-4f71-8be5-e633ef378bc4 service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:45.597381 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.compute.server_external_events [req-c1470f79-895d-4fd3-a7e4-89e9a9e3091a req-bcf713de-f577-4f71-8be5-e633ef378bc4 service nova] Creating event network-changed:a13ed13b-8d67-46d9-a44b-a3230486e080 for instance 73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b on hv-cinder-84980 Jul 21 10:49:45.613023 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [req-c1470f79-895d-4fd3-a7e4-89e9a9e3091a req-bcf713de-f577-4f71-8be5-e633ef378bc4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045820 Jul 21 10:49:45.622814 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 201/400] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 21 10:49:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:49:45.664022 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-55ef9d29-6851-4c38-8073-69404e724bda tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:49:45.664634 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-55ef9d29-6851-4c38-8073-69404e724bda tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] [instance: eb24f843-eeb3-43dd-bd48-3bcf68e344cd] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:49:45.719899 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-55ef9d29-6851-4c38-8073-69404e724bda tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e3fd195fd14b009ba56950dc542cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620ea9c4eaa74dc5858cf93d9fcad9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:45.728113 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-55ef9d29-6851-4c38-8073-69404e724bda tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] 10.222.0.48 "GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd" status: 200 len: 1088 microversion: 2.1 time: 0.067806 Jul 21 10:49:45.729748 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 200/401] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:49:45 2022] GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd => generated 1088 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:49:46.256710 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-3d6d690c-d210-4eab-88b0-e23053c968fa tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:49:46.257792 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-3d6d690c-d210-4eab-88b0-e23053c968fa tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:49:46.271741 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3d6d690c-d210-4eab-88b0-e23053c968fa tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:46.272866 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3d6d690c-d210-4eab-88b0-e23053c968fa tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:46.273867 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3d6d690c-d210-4eab-88b0-e23053c968fa tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:46.275247 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3d6d690c-d210-4eab-88b0-e23053c968fa tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:46.292175 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:49:46.493657 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-3d6d690c-d210-4eab-88b0-e23053c968fa tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:46.509968 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-3d6d690c-d210-4eab-88b0-e23053c968fa tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:46.516317 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-3d6d690c-d210-4eab-88b0-e23053c968fa tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:46.517799 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-3d6d690c-d210-4eab-88b0-e23053c968fa tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1750 microversion: 2.20 time: 0.265352 Jul 21 10:49:46.518525 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 202/402] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:49:46 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1750 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:49:46.748255 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-33654bda-b1c8-468f-adfd-1825f1db2ef5 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:49:46.748936 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-33654bda-b1c8-468f-adfd-1825f1db2ef5 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] [instance: eb24f843-eeb3-43dd-bd48-3bcf68e344cd] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:49:46.764403 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-33654bda-b1c8-468f-adfd-1825f1db2ef5 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:46.764849 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-33654bda-b1c8-468f-adfd-1825f1db2ef5 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:46.765624 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-33654bda-b1c8-468f-adfd-1825f1db2ef5 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:46.766055 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-33654bda-b1c8-468f-adfd-1825f1db2ef5 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:46.869909 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-33654bda-b1c8-468f-adfd-1825f1db2ef5 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e3fd195fd14b009ba56950dc542cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620ea9c4eaa74dc5858cf93d9fcad9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:46.883611 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-33654bda-b1c8-468f-adfd-1825f1db2ef5 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] 10.222.0.48 "GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd" status: 200 len: 1130 microversion: 2.1 time: 0.141001 Jul 21 10:49:46.894408 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 201/403] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:49:46 2022] GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd => generated 1130 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:49:47.536690 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-f2fc8ccb-80d3-49c5-893f-d48aeb77b48e tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:49:47.538101 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-f2fc8ccb-80d3-49c5-893f-d48aeb77b48e tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:49:47.547529 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f2fc8ccb-80d3-49c5-893f-d48aeb77b48e tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:47.548348 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f2fc8ccb-80d3-49c5-893f-d48aeb77b48e tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:47.549209 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f2fc8ccb-80d3-49c5-893f-d48aeb77b48e tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:47.549837 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f2fc8ccb-80d3-49c5-893f-d48aeb77b48e tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:47.710567 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-f2fc8ccb-80d3-49c5-893f-d48aeb77b48e tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:47.722162 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-f2fc8ccb-80d3-49c5-893f-d48aeb77b48e tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:47.724024 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-f2fc8ccb-80d3-49c5-893f-d48aeb77b48e tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:47.725359 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-f2fc8ccb-80d3-49c5-893f-d48aeb77b48e tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1752 microversion: 2.20 time: 0.192600 Jul 21 10:49:47.726453 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 203/404] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:49:47 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1752 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:49:47.901401 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-58960563-bc37-4d09-a963-691d294c757f tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:49:47.903786 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-58960563-bc37-4d09-a963-691d294c757f tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] [instance: eb24f843-eeb3-43dd-bd48-3bcf68e344cd] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:49:47.910407 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-58960563-bc37-4d09-a963-691d294c757f tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:47.911076 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-58960563-bc37-4d09-a963-691d294c757f tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:47.924716 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-58960563-bc37-4d09-a963-691d294c757f tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:47.926598 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-58960563-bc37-4d09-a963-691d294c757f tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:48.011121 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-58960563-bc37-4d09-a963-691d294c757f tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e3fd195fd14b009ba56950dc542cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620ea9c4eaa74dc5858cf93d9fcad9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:48.031612 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-58960563-bc37-4d09-a963-691d294c757f tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] 10.222.0.48 "GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd" status: 200 len: 1194 microversion: 2.1 time: 0.134058 Jul 21 10:49:48.032207 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 202/405] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:49:47 2022] GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd => generated 1194 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:49:48.747290 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-c3fca213-7ca1-4338-ac71-d4304a8843b8 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:49:48.747897 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-c3fca213-7ca1-4338-ac71-d4304a8843b8 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:49:48.758027 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c3fca213-7ca1-4338-ac71-d4304a8843b8 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:48.762301 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c3fca213-7ca1-4338-ac71-d4304a8843b8 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:48.762301 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c3fca213-7ca1-4338-ac71-d4304a8843b8 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:48.762301 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c3fca213-7ca1-4338-ac71-d4304a8843b8 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:48.959050 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-c3fca213-7ca1-4338-ac71-d4304a8843b8 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:48.971649 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-c3fca213-7ca1-4338-ac71-d4304a8843b8 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:48.973176 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-c3fca213-7ca1-4338-ac71-d4304a8843b8 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:48.974397 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-c3fca213-7ca1-4338-ac71-d4304a8843b8 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1808 microversion: 2.20 time: 0.234218 Jul 21 10:49:48.975283 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 204/406] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:49:48 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1808 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:49:49.051434 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-5820e693-b853-4d40-916d-aa22fe66a375 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:49:49.052150 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-5820e693-b853-4d40-916d-aa22fe66a375 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] [instance: eb24f843-eeb3-43dd-bd48-3bcf68e344cd] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:49:49.072599 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5820e693-b853-4d40-916d-aa22fe66a375 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:49.074459 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5820e693-b853-4d40-916d-aa22fe66a375 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:49.077698 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5820e693-b853-4d40-916d-aa22fe66a375 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:49.078389 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5820e693-b853-4d40-916d-aa22fe66a375 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:49.314738 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-5820e693-b853-4d40-916d-aa22fe66a375 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e3fd195fd14b009ba56950dc542cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620ea9c4eaa74dc5858cf93d9fcad9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:49.314738 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-5820e693-b853-4d40-916d-aa22fe66a375 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] 10.222.0.48 "GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd" status: 200 len: 1272 microversion: 2.1 time: 0.265227 Jul 21 10:49:49.323790 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 203/407] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:49:49 2022] GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd => generated 1272 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:49:49.993107 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-d2c764a5-e863-4351-a64c-1eba6866cf92 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:49:49.993694 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-d2c764a5-e863-4351-a64c-1eba6866cf92 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:49:50.000354 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d2c764a5-e863-4351-a64c-1eba6866cf92 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:50.000841 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d2c764a5-e863-4351-a64c-1eba6866cf92 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:50.001653 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d2c764a5-e863-4351-a64c-1eba6866cf92 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:50.002079 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d2c764a5-e863-4351-a64c-1eba6866cf92 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:50.191199 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-d2c764a5-e863-4351-a64c-1eba6866cf92 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:50.201271 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-d2c764a5-e863-4351-a64c-1eba6866cf92 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:50.205684 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-d2c764a5-e863-4351-a64c-1eba6866cf92 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:50.207259 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-d2c764a5-e863-4351-a64c-1eba6866cf92 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1808 microversion: 2.20 time: 0.218131 Jul 21 10:49:50.208372 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 205/408] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:49:49 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1808 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:49:50.328470 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-78496508-ec18-4df1-a1c8-591ae7aef1e8 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:49:50.329078 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-78496508-ec18-4df1-a1c8-591ae7aef1e8 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] [instance: eb24f843-eeb3-43dd-bd48-3bcf68e344cd] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:49:50.345755 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-78496508-ec18-4df1-a1c8-591ae7aef1e8 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:50.346492 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-78496508-ec18-4df1-a1c8-591ae7aef1e8 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:50.347470 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-78496508-ec18-4df1-a1c8-591ae7aef1e8 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:50.347902 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-78496508-ec18-4df1-a1c8-591ae7aef1e8 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:50.459751 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-7f5592f1-ddfd-444c-a3e6-3f72df40065d tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:49:50.460447 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-7f5592f1-ddfd-444c-a3e6-3f72df40065d tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] [instance: dc183ff4-10bd-4827-a6a8-17f6b6d739be] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:49:50.471125 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7f5592f1-ddfd-444c-a3e6-3f72df40065d tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:50.474266 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7f5592f1-ddfd-444c-a3e6-3f72df40065d tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:50.475308 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7f5592f1-ddfd-444c-a3e6-3f72df40065d tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:50.478417 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7f5592f1-ddfd-444c-a3e6-3f72df40065d tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:50.566044 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-78496508-ec18-4df1-a1c8-591ae7aef1e8 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e3fd195fd14b009ba56950dc542cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620ea9c4eaa74dc5858cf93d9fcad9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:50.573843 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-78496508-ec18-4df1-a1c8-591ae7aef1e8 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] 10.222.0.48 "GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd" status: 200 len: 1272 microversion: 2.1 time: 0.249831 Jul 21 10:49:50.584063 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 204/409] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:49:50 2022] GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd => generated 1272 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:49:50.602790 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [req-9797bea0-051b-4b80-ac3f-97efa1012865 req-4941fa57-cdd2-412d-a300-f203e5014565 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb24f843-eeb3-43dd-bd48-3bcf68e344cd", "tag": "2741d1f0-6bcb-4bee-8842-bc9bf8bc4db2"}]} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:49:50.617870 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-9797bea0-051b-4b80-ac3f-97efa1012865 req-4941fa57-cdd2-412d-a300-f203e5014565 service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:50.618917 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-9797bea0-051b-4b80-ac3f-97efa1012865 req-4941fa57-cdd2-412d-a300-f203e5014565 service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:50.631470 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.compute.server_external_events [req-9797bea0-051b-4b80-ac3f-97efa1012865 req-4941fa57-cdd2-412d-a300-f203e5014565 service nova] Creating event network-changed:2741d1f0-6bcb-4bee-8842-bc9bf8bc4db2 for instance eb24f843-eeb3-43dd-bd48-3bcf68e344cd on hv-cinder-84980 Jul 21 10:49:50.638918 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [req-9797bea0-051b-4b80-ac3f-97efa1012865 req-4941fa57-cdd2-412d-a300-f203e5014565 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039830 Jul 21 10:49:50.640498 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 205/410] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 21 10:49:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:49:50.731572 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.objects.instance [None req-7f5592f1-ddfd-444c-a3e6-3f72df40065d tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lazy-loading 'services' on Instance uuid dc183ff4-10bd-4827-a6a8-17f6b6d739be {{(pid=124867) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 10:49:51.207228 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-7f5592f1-ddfd-444c-a3e6-3f72df40065d tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] 10.222.0.48 "DELETE /compute/v2.1/servers/dc183ff4-10bd-4827-a6a8-17f6b6d739be/os-volume_attachments/f6f0257b-3a73-442f-8492-4caedf6103fe" status: 202 len: 0 microversion: 2.1 time: 0.750869 Jul 21 10:49:51.211684 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 206/411] 10.222.0.48 () {58 vars in 1415 bytes} [Thu Jul 21 10:49:50 2022] DELETE /compute/v2.1/servers/dc183ff4-10bd-4827-a6a8-17f6b6d739be/os-volume_attachments/f6f0257b-3a73-442f-8492-4caedf6103fe => generated 0 bytes in 756 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 10:49:51.230970 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-e338b5c1-f1b0-4114-98a8-e1b6c4efbc3e tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:49:51.233669 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-e338b5c1-f1b0-4114-98a8-e1b6c4efbc3e tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:49:51.242875 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e338b5c1-f1b0-4114-98a8-e1b6c4efbc3e tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:51.244433 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e338b5c1-f1b0-4114-98a8-e1b6c4efbc3e tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:51.245471 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e338b5c1-f1b0-4114-98a8-e1b6c4efbc3e tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:51.247456 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e338b5c1-f1b0-4114-98a8-e1b6c4efbc3e tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:51.269984 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell1:SELECT=100 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:49:51.464888 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-e338b5c1-f1b0-4114-98a8-e1b6c4efbc3e tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:51.474861 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-e338b5c1-f1b0-4114-98a8-e1b6c4efbc3e tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:51.476566 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-e338b5c1-f1b0-4114-98a8-e1b6c4efbc3e tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:51.477900 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-e338b5c1-f1b0-4114-98a8-e1b6c4efbc3e tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1808 microversion: 2.20 time: 0.256469 Jul 21 10:49:51.478461 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 206/412] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:49:51 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1808 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:49:51.601435 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-e23e43ea-4929-4090-b39f-95ad0842d7d7 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:49:51.602741 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-e23e43ea-4929-4090-b39f-95ad0842d7d7 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] [instance: eb24f843-eeb3-43dd-bd48-3bcf68e344cd] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:49:51.619460 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e23e43ea-4929-4090-b39f-95ad0842d7d7 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:51.620480 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e23e43ea-4929-4090-b39f-95ad0842d7d7 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:51.624793 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e23e43ea-4929-4090-b39f-95ad0842d7d7 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:51.625604 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e23e43ea-4929-4090-b39f-95ad0842d7d7 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:51.805868 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-e23e43ea-4929-4090-b39f-95ad0842d7d7 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e3fd195fd14b009ba56950dc542cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620ea9c4eaa74dc5858cf93d9fcad9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:51.816923 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-e23e43ea-4929-4090-b39f-95ad0842d7d7 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] 10.222.0.48 "GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd" status: 200 len: 1260 microversion: 2.1 time: 0.225372 Jul 21 10:49:51.826697 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 207/413] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:49:51 2022] GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd => generated 1260 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:49:51.954273 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-33803493-d45b-4bce-b83e-25289b430ab5 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Action: 'create', calling method: .version_select at 0x7f796350ddc0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-925942524", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMIzJ0BgJffLdlKKTjGx90nITqMpgDt4C8F0OWXldmbzeRYQw1QfAdcyChc0igTIVBYMd19CS/vASdz8fsOG9Lul92Wdhc+6z9W4t/HXmB5fbOs2DlLrmOVG8prBAukWLA=="}} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:49:51.984100 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.quota [None req-33803493-d45b-4bce-b83e-25289b430ab5 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Getting quotas for project 2eff05785bd84522ad637d8bed14563d. Resources: {'key_pairs'} {{(pid=124868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 10:49:52.000704 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.quota [None req-33803493-d45b-4bce-b83e-25289b430ab5 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Getting quotas for user 4ae0271efe4b4e9592b29d9f124519b7 and project 2eff05785bd84522ad637d8bed14563d. Resources: {'key_pairs'} {{(pid=124868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 10:49:52.122108 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-33803493-d45b-4bce-b83e-25289b430ab5 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.174480 Jul 21 10:49:52.122414 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 207/414] 10.222.0.48 () {60 vars in 1158 bytes} [Thu Jul 21 10:49:51 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:49:52.201110 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-60514dee-5fc8-4d57-90cc-91e911fb83aa tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1882844682", "imageRef": "8c663641-a5f2-4f7a-bd49-abaef6ce27bc", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-925942524", "networks": [{"uuid": "bfcc1ddb-0fed-4d87-9302-25a2c7f2725d"}]}} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:49:52.258772 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.network.neutron [None req-60514dee-5fc8-4d57-90cc-91e911fb83aa tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] validate_networks() for [('bfcc1ddb-0fed-4d87-9302-25a2c7f2725d', None, None, None, None, None)] {{(pid=124867) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 10:49:52.497828 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-a8cfd581-2a11-42ed-8a1b-75ad3980f92d tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:49:52.498380 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-a8cfd581-2a11-42ed-8a1b-75ad3980f92d tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:49:52.505456 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a8cfd581-2a11-42ed-8a1b-75ad3980f92d tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:52.506149 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a8cfd581-2a11-42ed-8a1b-75ad3980f92d tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:52.507124 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a8cfd581-2a11-42ed-8a1b-75ad3980f92d tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:52.507729 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a8cfd581-2a11-42ed-8a1b-75ad3980f92d tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:52.854509 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell0:SELECT=2 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:49:52.989950 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-a8cfd581-2a11-42ed-8a1b-75ad3980f92d tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:53.000447 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-a8cfd581-2a11-42ed-8a1b-75ad3980f92d tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:53.002331 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-a8cfd581-2a11-42ed-8a1b-75ad3980f92d tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:53.003794 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-a8cfd581-2a11-42ed-8a1b-75ad3980f92d tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1808 microversion: 2.20 time: 0.510835 Jul 21 10:49:53.015667 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 208/415] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:49:52 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1808 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:49:53.019841 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-60514dee-5fc8-4d57-90cc-91e911fb83aa tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Flavor limits 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 10:49:53.020375 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-60514dee-5fc8-4d57-90cc-91e911fb83aa tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Image limits 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 10:49:53.021075 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-60514dee-5fc8-4d57-90cc-91e911fb83aa tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Flavor pref 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 10:49:53.021604 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-60514dee-5fc8-4d57-90cc-91e911fb83aa tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Image pref 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 10:49:53.022230 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-ea5545ee-c68e-4077-ad23-e8d17212ef25 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:49:53.022365 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-60514dee-5fc8-4d57-90cc-91e911fb83aa tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 10:49:53.023133 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-ea5545ee-c68e-4077-ad23-e8d17212ef25 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] [instance: eb24f843-eeb3-43dd-bd48-3bcf68e344cd] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:49:53.030618 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ea5545ee-c68e-4077-ad23-e8d17212ef25 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:53.031332 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ea5545ee-c68e-4077-ad23-e8d17212ef25 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:53.032269 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ea5545ee-c68e-4077-ad23-e8d17212ef25 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:53.033052 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ea5545ee-c68e-4077-ad23-e8d17212ef25 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:53.033175 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-60514dee-5fc8-4d57-90cc-91e911fb83aa tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:53.033693 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-60514dee-5fc8-4d57-90cc-91e911fb83aa tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:53.034640 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-60514dee-5fc8-4d57-90cc-91e911fb83aa tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:53.035178 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-60514dee-5fc8-4d57-90cc-91e911fb83aa tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:53.055342 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.quota [None req-60514dee-5fc8-4d57-90cc-91e911fb83aa tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Getting quotas for project 2eff05785bd84522ad637d8bed14563d. Resources: {'ram', 'instances', 'cores'} {{(pid=124867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 10:49:53.059690 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.quota [None req-60514dee-5fc8-4d57-90cc-91e911fb83aa tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Getting quotas for user 4ae0271efe4b4e9592b29d9f124519b7 and project 2eff05785bd84522ad637d8bed14563d. Resources: {'ram', 'instances', 'cores'} {{(pid=124867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 10:49:53.071538 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-60514dee-5fc8-4d57-90cc-91e911fb83aa tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Going to run 1 instances... {{(pid=124867) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 10:49:53.074573 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-60514dee-5fc8-4d57-90cc-91e911fb83aa tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] [instance: 6597f555-38e1-4d14-bf7c-6d8b5e5a26d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c663641-a5f2-4f7a-bd49-abaef6ce27bc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124867) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 10:49:53.186671 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-ea5545ee-c68e-4077-ad23-e8d17212ef25 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e3fd195fd14b009ba56950dc542cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620ea9c4eaa74dc5858cf93d9fcad9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:53.207505 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-ea5545ee-c68e-4077-ad23-e8d17212ef25 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] 10.222.0.48 "GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd" status: 200 len: 1260 microversion: 2.1 time: 0.190364 Jul 21 10:49:53.208467 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 209/416] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:49:53 2022] GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd => generated 1260 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:49:53.213207 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-28ee561e-ecf9-4809-9052-5c6fd71ba6c2 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "14daff22-cc81-4f39-a09e-4f34e374cfa0"}} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:49:53.215938 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-60514dee-5fc8-4d57-90cc-91e911fb83aa tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.019270 Jul 21 10:49:53.216597 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 208/417] 10.222.0.48 () {60 vars in 1146 bytes} [Thu Jul 21 10:49:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1021 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 10:49:53.219847 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-28ee561e-ecf9-4809-9052-5c6fd71ba6c2 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: a54643be-3f53-4fe5-bab0-786b71d627bb] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:49:53.227253 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-b513ae58-fc1e-4f11-beee-e7c445acb865 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:49:53.228078 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-b513ae58-fc1e-4f11-beee-e7c445acb865 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] [instance: 6597f555-38e1-4d14-bf7c-6d8b5e5a26d4] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:49:53.249904 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-28ee561e-ecf9-4809-9052-5c6fd71ba6c2 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:53.251305 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-28ee561e-ecf9-4809-9052-5c6fd71ba6c2 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:53.252862 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-28ee561e-ecf9-4809-9052-5c6fd71ba6c2 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:53.253762 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-28ee561e-ecf9-4809-9052-5c6fd71ba6c2 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:53.323453 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-b513ae58-fc1e-4f11-beee-e7c445acb865 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0271efe4b4e9592b29d9f124519b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eff05785bd84522ad637d8bed14563d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:53.333847 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-b513ae58-fc1e-4f11-beee-e7c445acb865 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] 10.222.0.48 "GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4" status: 200 len: 1258 microversion: 2.1 time: 0.110674 Jul 21 10:49:53.334426 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 209/418] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:49:53 2022] GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4 => generated 1258 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:49:54.024788 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-c4b9dd0c-12f2-4966-8cfe-fbecbe32277b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:49:54.025985 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-c4b9dd0c-12f2-4966-8cfe-fbecbe32277b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:49:54.035700 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c4b9dd0c-12f2-4966-8cfe-fbecbe32277b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:54.036243 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c4b9dd0c-12f2-4966-8cfe-fbecbe32277b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:54.037234 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c4b9dd0c-12f2-4966-8cfe-fbecbe32277b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:54.037819 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c4b9dd0c-12f2-4966-8cfe-fbecbe32277b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:54.214955 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-c4b9dd0c-12f2-4966-8cfe-fbecbe32277b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:54.225090 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-c4b9dd0c-12f2-4966-8cfe-fbecbe32277b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:54.227020 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-c4b9dd0c-12f2-4966-8cfe-fbecbe32277b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:54.228504 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-c4b9dd0c-12f2-4966-8cfe-fbecbe32277b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1808 microversion: 2.20 time: 0.207875 Jul 21 10:49:54.229292 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 210/419] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:49:54 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1808 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 10:49:54.235021 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-b6aef3e5-d9e4-45b5-a4ba-fb5c2c8e2d84 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:49:54.236144 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-b6aef3e5-d9e4-45b5-a4ba-fb5c2c8e2d84 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] [instance: eb24f843-eeb3-43dd-bd48-3bcf68e344cd] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:49:54.238302 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:49:54.243416 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b6aef3e5-d9e4-45b5-a4ba-fb5c2c8e2d84 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:54.243967 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b6aef3e5-d9e4-45b5-a4ba-fb5c2c8e2d84 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:54.244824 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b6aef3e5-d9e4-45b5-a4ba-fb5c2c8e2d84 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:54.245361 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b6aef3e5-d9e4-45b5-a4ba-fb5c2c8e2d84 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:54.415459 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-b6aef3e5-d9e4-45b5-a4ba-fb5c2c8e2d84 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e3fd195fd14b009ba56950dc542cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620ea9c4eaa74dc5858cf93d9fcad9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:54.423914 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-b6aef3e5-d9e4-45b5-a4ba-fb5c2c8e2d84 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] 10.222.0.48 "GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd" status: 200 len: 1260 microversion: 2.1 time: 0.193204 Jul 21 10:49:54.424835 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 211/420] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:49:54 2022] GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd => generated 1260 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:49:54.430884 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-616abac7-5f54-45ab-b419-db141c5ae589 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:49:54.436136 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-616abac7-5f54-45ab-b419-db141c5ae589 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] [instance: 6597f555-38e1-4d14-bf7c-6d8b5e5a26d4] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:49:54.502910 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-616abac7-5f54-45ab-b419-db141c5ae589 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0271efe4b4e9592b29d9f124519b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eff05785bd84522ad637d8bed14563d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:54.509799 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-616abac7-5f54-45ab-b419-db141c5ae589 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] 10.222.0.48 "GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4" status: 200 len: 1258 microversion: 2.1 time: 0.083766 Jul 21 10:49:54.510670 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 212/421] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:49:54 2022] GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4 => generated 1258 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:49:55.256742 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-73793585-1c7f-4b01-8a48-68dc082c8390 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:49:55.258215 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-73793585-1c7f-4b01-8a48-68dc082c8390 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:49:55.269272 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-73793585-1c7f-4b01-8a48-68dc082c8390 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:55.282115 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-73793585-1c7f-4b01-8a48-68dc082c8390 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:55.282115 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-73793585-1c7f-4b01-8a48-68dc082c8390 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:55.282115 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-73793585-1c7f-4b01-8a48-68dc082c8390 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:55.421747 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-73793585-1c7f-4b01-8a48-68dc082c8390 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:55.431856 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-73793585-1c7f-4b01-8a48-68dc082c8390 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:55.435237 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-73793585-1c7f-4b01-8a48-68dc082c8390 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:55.436573 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-73793585-1c7f-4b01-8a48-68dc082c8390 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1808 microversion: 2.20 time: 0.184842 Jul 21 10:49:55.437439 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 213/422] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:49:55 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1808 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:49:55.442858 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-198627db-9e3e-49d9-b06f-73ff7a72f905 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:49:55.442858 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-198627db-9e3e-49d9-b06f-73ff7a72f905 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] [instance: eb24f843-eeb3-43dd-bd48-3bcf68e344cd] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:49:55.449849 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-198627db-9e3e-49d9-b06f-73ff7a72f905 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:55.450422 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-198627db-9e3e-49d9-b06f-73ff7a72f905 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:55.451344 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-198627db-9e3e-49d9-b06f-73ff7a72f905 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:55.451905 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-198627db-9e3e-49d9-b06f-73ff7a72f905 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:55.609594 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-198627db-9e3e-49d9-b06f-73ff7a72f905 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e3fd195fd14b009ba56950dc542cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620ea9c4eaa74dc5858cf93d9fcad9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:55.617701 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-198627db-9e3e-49d9-b06f-73ff7a72f905 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] 10.222.0.48 "GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd" status: 200 len: 1260 microversion: 2.1 time: 0.178974 Jul 21 10:49:55.618260 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 214/423] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:49:55 2022] GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd => generated 1260 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:49:55.624282 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-32146fd5-a35f-4e40-9f8e-c6388f6a8e93 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:49:55.624887 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-32146fd5-a35f-4e40-9f8e-c6388f6a8e93 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] [instance: 6597f555-38e1-4d14-bf7c-6d8b5e5a26d4] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:49:55.631434 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-32146fd5-a35f-4e40-9f8e-c6388f6a8e93 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:55.631882 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-32146fd5-a35f-4e40-9f8e-c6388f6a8e93 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:55.632653 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-32146fd5-a35f-4e40-9f8e-c6388f6a8e93 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:55.633350 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-32146fd5-a35f-4e40-9f8e-c6388f6a8e93 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:55.698404 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-32146fd5-a35f-4e40-9f8e-c6388f6a8e93 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0271efe4b4e9592b29d9f124519b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eff05785bd84522ad637d8bed14563d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:55.706371 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-32146fd5-a35f-4e40-9f8e-c6388f6a8e93 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] 10.222.0.48 "GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4" status: 200 len: 1262 microversion: 2.1 time: 0.086737 Jul 21 10:49:55.707170 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 215/424] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:49:55 2022] GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4 => generated 1262 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:49:56.458573 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-88952658-1ffb-4c55-83e4-54089f194dd6 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:49:56.459574 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-88952658-1ffb-4c55-83e4-54089f194dd6 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:49:56.466254 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-88952658-1ffb-4c55-83e4-54089f194dd6 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:56.466735 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-88952658-1ffb-4c55-83e4-54089f194dd6 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:56.467496 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-88952658-1ffb-4c55-83e4-54089f194dd6 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:56.468191 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-88952658-1ffb-4c55-83e4-54089f194dd6 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:56.611063 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-88952658-1ffb-4c55-83e4-54089f194dd6 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:56.620414 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-88952658-1ffb-4c55-83e4-54089f194dd6 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:56.622908 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-88952658-1ffb-4c55-83e4-54089f194dd6 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:56.625490 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-88952658-1ffb-4c55-83e4-54089f194dd6 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1808 microversion: 2.20 time: 0.170848 Jul 21 10:49:56.625490 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 216/425] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:49:56 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:49:56.640419 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-41dfcb9a-f7ed-44ce-b141-5ed593a5e502 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:49:56.641017 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-41dfcb9a-f7ed-44ce-b141-5ed593a5e502 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] [instance: eb24f843-eeb3-43dd-bd48-3bcf68e344cd] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:49:56.647629 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-41dfcb9a-f7ed-44ce-b141-5ed593a5e502 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:56.648106 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-41dfcb9a-f7ed-44ce-b141-5ed593a5e502 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:56.650578 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-41dfcb9a-f7ed-44ce-b141-5ed593a5e502 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:56.651083 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-41dfcb9a-f7ed-44ce-b141-5ed593a5e502 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:56.802857 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-41dfcb9a-f7ed-44ce-b141-5ed593a5e502 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e3fd195fd14b009ba56950dc542cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620ea9c4eaa74dc5858cf93d9fcad9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:56.810973 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-41dfcb9a-f7ed-44ce-b141-5ed593a5e502 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] 10.222.0.48 "GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd" status: 200 len: 1260 microversion: 2.1 time: 0.175023 Jul 21 10:49:56.816538 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 217/426] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:49:56 2022] GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd => generated 1260 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:49:56.816538 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-5b4cf092-3701-4aa0-95e1-c807f318312e tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:49:56.816746 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-5b4cf092-3701-4aa0-95e1-c807f318312e tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] [instance: 6597f555-38e1-4d14-bf7c-6d8b5e5a26d4] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:49:56.823002 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5b4cf092-3701-4aa0-95e1-c807f318312e tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:56.823453 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5b4cf092-3701-4aa0-95e1-c807f318312e tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:56.824770 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5b4cf092-3701-4aa0-95e1-c807f318312e tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:56.825198 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5b4cf092-3701-4aa0-95e1-c807f318312e tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:56.896129 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-5b4cf092-3701-4aa0-95e1-c807f318312e tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0271efe4b4e9592b29d9f124519b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eff05785bd84522ad637d8bed14563d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:56.904412 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-5b4cf092-3701-4aa0-95e1-c807f318312e tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] 10.222.0.48 "GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4" status: 200 len: 1262 microversion: 2.1 time: 0.091729 Jul 21 10:49:56.904992 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 218/427] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:49:56 2022] GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4 => generated 1262 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:49:57.643070 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-7c524a7f-a479-411d-bd27-e6d32a9ea55b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:49:57.643741 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-7c524a7f-a479-411d-bd27-e6d32a9ea55b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:49:57.649825 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7c524a7f-a479-411d-bd27-e6d32a9ea55b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:57.650271 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7c524a7f-a479-411d-bd27-e6d32a9ea55b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:57.651068 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7c524a7f-a479-411d-bd27-e6d32a9ea55b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:57.651504 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7c524a7f-a479-411d-bd27-e6d32a9ea55b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:57.790925 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-7c524a7f-a479-411d-bd27-e6d32a9ea55b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:57.799834 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-7c524a7f-a479-411d-bd27-e6d32a9ea55b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:57.801334 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-7c524a7f-a479-411d-bd27-e6d32a9ea55b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:57.802496 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-7c524a7f-a479-411d-bd27-e6d32a9ea55b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1808 microversion: 2.20 time: 0.163411 Jul 21 10:49:57.803246 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 219/428] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:49:57 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 10:49:57.829586 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-81b83c3d-6ddf-4748-9df2-55e7c2a31fa9 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:49:57.830202 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-81b83c3d-6ddf-4748-9df2-55e7c2a31fa9 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] [instance: eb24f843-eeb3-43dd-bd48-3bcf68e344cd] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:49:57.836623 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-81b83c3d-6ddf-4748-9df2-55e7c2a31fa9 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:57.837076 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-81b83c3d-6ddf-4748-9df2-55e7c2a31fa9 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:57.837857 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-81b83c3d-6ddf-4748-9df2-55e7c2a31fa9 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:57.838291 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-81b83c3d-6ddf-4748-9df2-55e7c2a31fa9 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:57.978193 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-81b83c3d-6ddf-4748-9df2-55e7c2a31fa9 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e3fd195fd14b009ba56950dc542cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620ea9c4eaa74dc5858cf93d9fcad9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:57.985703 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:49:57.988027 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-81b83c3d-6ddf-4748-9df2-55e7c2a31fa9 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] 10.222.0.48 "GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd" status: 200 len: 1260 microversion: 2.1 time: 0.162602 Jul 21 10:49:57.988622 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 220/429] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:49:57 2022] GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd => generated 1260 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:49:57.993169 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-d9d9e0a3-d35d-4ea0-9c4a-4c4801360c18 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:49:57.994219 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-d9d9e0a3-d35d-4ea0-9c4a-4c4801360c18 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] [instance: 6597f555-38e1-4d14-bf7c-6d8b5e5a26d4] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:49:58.000767 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d9d9e0a3-d35d-4ea0-9c4a-4c4801360c18 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:58.001214 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d9d9e0a3-d35d-4ea0-9c4a-4c4801360c18 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:58.001984 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d9d9e0a3-d35d-4ea0-9c4a-4c4801360c18 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:58.002419 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d9d9e0a3-d35d-4ea0-9c4a-4c4801360c18 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:58.071541 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-d9d9e0a3-d35d-4ea0-9c4a-4c4801360c18 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0271efe4b4e9592b29d9f124519b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eff05785bd84522ad637d8bed14563d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:58.077004 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-d9d9e0a3-d35d-4ea0-9c4a-4c4801360c18 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] 10.222.0.48 "GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4" status: 200 len: 1262 microversion: 2.1 time: 0.087327 Jul 21 10:49:58.077581 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 221/430] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:49:57 2022] GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4 => generated 1262 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:49:58.821756 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-1abb4e4b-0171-4ff9-bf09-7facb114dddf tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:49:58.822597 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-1abb4e4b-0171-4ff9-bf09-7facb114dddf tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:49:58.829386 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1abb4e4b-0171-4ff9-bf09-7facb114dddf tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:58.829826 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1abb4e4b-0171-4ff9-bf09-7facb114dddf tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:58.830669 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1abb4e4b-0171-4ff9-bf09-7facb114dddf tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:58.831101 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1abb4e4b-0171-4ff9-bf09-7facb114dddf tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:58.987492 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-1abb4e4b-0171-4ff9-bf09-7facb114dddf tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:58.998318 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-1abb4e4b-0171-4ff9-bf09-7facb114dddf tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:59.000664 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-1abb4e4b-0171-4ff9-bf09-7facb114dddf tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:59.001860 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-1abb4e4b-0171-4ff9-bf09-7facb114dddf tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1808 microversion: 2.20 time: 0.184474 Jul 21 10:49:59.013511 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 222/431] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:49:58 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1808 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 10:49:59.018794 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-0ff5b47b-0187-40c4-902a-fab01fb589e5 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:49:59.019457 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-0ff5b47b-0187-40c4-902a-fab01fb589e5 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] [instance: eb24f843-eeb3-43dd-bd48-3bcf68e344cd] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:49:59.027544 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0ff5b47b-0187-40c4-902a-fab01fb589e5 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:59.028111 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0ff5b47b-0187-40c4-902a-fab01fb589e5 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:59.028958 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0ff5b47b-0187-40c4-902a-fab01fb589e5 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:59.029390 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0ff5b47b-0187-40c4-902a-fab01fb589e5 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:59.175639 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-0ff5b47b-0187-40c4-902a-fab01fb589e5 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e3fd195fd14b009ba56950dc542cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620ea9c4eaa74dc5858cf93d9fcad9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:59.184041 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-0ff5b47b-0187-40c4-902a-fab01fb589e5 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] 10.222.0.48 "GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd" status: 200 len: 1260 microversion: 2.1 time: 0.168879 Jul 21 10:49:59.184617 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 223/432] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:49:59 2022] GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd => generated 1260 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:49:59.189542 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-0fdb657d-a200-4e54-8de1-f5fb2e315cb2 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:49:59.190153 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-0fdb657d-a200-4e54-8de1-f5fb2e315cb2 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] [instance: 6597f555-38e1-4d14-bf7c-6d8b5e5a26d4] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:49:59.196508 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0fdb657d-a200-4e54-8de1-f5fb2e315cb2 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:59.196967 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0fdb657d-a200-4e54-8de1-f5fb2e315cb2 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:59.197750 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0fdb657d-a200-4e54-8de1-f5fb2e315cb2 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:49:59.198190 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0fdb657d-a200-4e54-8de1-f5fb2e315cb2 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:49:59.274251 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-0fdb657d-a200-4e54-8de1-f5fb2e315cb2 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0271efe4b4e9592b29d9f124519b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eff05785bd84522ad637d8bed14563d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:49:59.282604 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-0fdb657d-a200-4e54-8de1-f5fb2e315cb2 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] 10.222.0.48 "GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4" status: 200 len: 1262 microversion: 2.1 time: 0.096801 Jul 21 10:49:59.283414 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 224/433] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:49:59 2022] GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4 => generated 1262 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:50:00.020273 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-afb18a3f-a3b0-44a9-8f79-1bdf2e7ea069 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:00.020952 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-afb18a3f-a3b0-44a9-8f79-1bdf2e7ea069 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:00.028046 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-afb18a3f-a3b0-44a9-8f79-1bdf2e7ea069 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:00.028501 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-afb18a3f-a3b0-44a9-8f79-1bdf2e7ea069 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:00.029276 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-afb18a3f-a3b0-44a9-8f79-1bdf2e7ea069 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:00.030749 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-afb18a3f-a3b0-44a9-8f79-1bdf2e7ea069 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:00.169052 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-afb18a3f-a3b0-44a9-8f79-1bdf2e7ea069 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:00.177972 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-afb18a3f-a3b0-44a9-8f79-1bdf2e7ea069 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:00.179945 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-afb18a3f-a3b0-44a9-8f79-1bdf2e7ea069 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:00.180705 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-afb18a3f-a3b0-44a9-8f79-1bdf2e7ea069 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1808 microversion: 2.20 time: 0.164512 Jul 21 10:50:00.181283 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 225/434] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:50:00 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:50:00.201934 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-b779e392-e3bc-4057-bf95-a9f7812cec6e tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:00.202535 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-b779e392-e3bc-4057-bf95-a9f7812cec6e tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] [instance: eb24f843-eeb3-43dd-bd48-3bcf68e344cd] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:00.208762 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b779e392-e3bc-4057-bf95-a9f7812cec6e tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:00.209204 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b779e392-e3bc-4057-bf95-a9f7812cec6e tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:00.209956 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b779e392-e3bc-4057-bf95-a9f7812cec6e tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:00.210389 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b779e392-e3bc-4057-bf95-a9f7812cec6e tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:00.339350 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-b779e392-e3bc-4057-bf95-a9f7812cec6e tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e3fd195fd14b009ba56950dc542cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620ea9c4eaa74dc5858cf93d9fcad9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:00.347146 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-b779e392-e3bc-4057-bf95-a9f7812cec6e tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] 10.222.0.48 "GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd" status: 200 len: 1260 microversion: 2.1 time: 0.150432 Jul 21 10:50:00.347743 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 226/435] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:00 2022] GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:50:00.352081 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-21d87c0c-7003-4ff7-898b-87668c1fe49b tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:00.352650 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-21d87c0c-7003-4ff7-898b-87668c1fe49b tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] [instance: 6597f555-38e1-4d14-bf7c-6d8b5e5a26d4] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:00.360126 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-21d87c0c-7003-4ff7-898b-87668c1fe49b tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:00.360578 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-21d87c0c-7003-4ff7-898b-87668c1fe49b tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:00.361336 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-21d87c0c-7003-4ff7-898b-87668c1fe49b tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:00.361902 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-21d87c0c-7003-4ff7-898b-87668c1fe49b tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:00.424461 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-21d87c0c-7003-4ff7-898b-87668c1fe49b tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0271efe4b4e9592b29d9f124519b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eff05785bd84522ad637d8bed14563d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:00.431815 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-21d87c0c-7003-4ff7-898b-87668c1fe49b tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] 10.222.0.48 "GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4" status: 200 len: 1262 microversion: 2.1 time: 0.083140 Jul 21 10:50:00.432361 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 227/436] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:00 2022] GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4 => generated 1262 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:50:01.200514 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-5db0a0c4-74d0-42fb-ad3c-c1eb962aa719 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:01.201183 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-5db0a0c4-74d0-42fb-ad3c-c1eb962aa719 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:01.210337 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5db0a0c4-74d0-42fb-ad3c-c1eb962aa719 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:01.211257 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5db0a0c4-74d0-42fb-ad3c-c1eb962aa719 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:01.211689 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5db0a0c4-74d0-42fb-ad3c-c1eb962aa719 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:01.212129 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5db0a0c4-74d0-42fb-ad3c-c1eb962aa719 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:01.353955 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-5db0a0c4-74d0-42fb-ad3c-c1eb962aa719 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:01.363059 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-5db0a0c4-74d0-42fb-ad3c-c1eb962aa719 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:01.366814 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-5db0a0c4-74d0-42fb-ad3c-c1eb962aa719 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:01.366814 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-5db0a0c4-74d0-42fb-ad3c-c1eb962aa719 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1808 microversion: 2.20 time: 0.169743 Jul 21 10:50:01.366814 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 228/437] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:50:01 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 10:50:01.370745 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-1c3c9484-ef76-41a8-b297-8a280e44af3b tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:01.371473 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-1c3c9484-ef76-41a8-b297-8a280e44af3b tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] [instance: eb24f843-eeb3-43dd-bd48-3bcf68e344cd] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:01.377277 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1c3c9484-ef76-41a8-b297-8a280e44af3b tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:01.377727 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1c3c9484-ef76-41a8-b297-8a280e44af3b tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:01.378487 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1c3c9484-ef76-41a8-b297-8a280e44af3b tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:01.378952 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1c3c9484-ef76-41a8-b297-8a280e44af3b tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:01.520782 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-1c3c9484-ef76-41a8-b297-8a280e44af3b tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e3fd195fd14b009ba56950dc542cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620ea9c4eaa74dc5858cf93d9fcad9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:01.528847 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-1c3c9484-ef76-41a8-b297-8a280e44af3b tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] 10.222.0.48 "GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd" status: 200 len: 1260 microversion: 2.1 time: 0.161563 Jul 21 10:50:01.529421 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 229/438] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:01 2022] GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:50:01.533943 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-fda08a56-61da-40b9-94b9-acdbf5248ed2 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:01.534559 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-fda08a56-61da-40b9-94b9-acdbf5248ed2 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] [instance: 6597f555-38e1-4d14-bf7c-6d8b5e5a26d4] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:01.540309 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fda08a56-61da-40b9-94b9-acdbf5248ed2 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:01.540754 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fda08a56-61da-40b9-94b9-acdbf5248ed2 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:01.541508 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fda08a56-61da-40b9-94b9-acdbf5248ed2 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:01.541943 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fda08a56-61da-40b9-94b9-acdbf5248ed2 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:01.606390 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-fda08a56-61da-40b9-94b9-acdbf5248ed2 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0271efe4b4e9592b29d9f124519b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eff05785bd84522ad637d8bed14563d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:01.613770 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-fda08a56-61da-40b9-94b9-acdbf5248ed2 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] 10.222.0.48 "GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4" status: 200 len: 1310 microversion: 2.1 time: 0.083421 Jul 21 10:50:01.614330 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 230/439] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:01 2022] GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4 => generated 1310 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:50:01.736601 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-28ee561e-ecf9-4809-9052-5c6fd71ba6c2 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "POST /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 8.526429 Jul 21 10:50:01.737197 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 210/440] 10.222.0.48 () {60 vars in 1322 bytes} [Thu Jul 21 10:49:53 2022] POST /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb/os-volume_attachments => generated 194 bytes in 8528 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:50:02.009033 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-824c4a4d-4340-4a78-82d4-d3f2eb24c721 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:02.009532 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-824c4a4d-4340-4a78-82d4-d3f2eb24c721 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] [instance: dc183ff4-10bd-4827-a6a8-17f6b6d739be] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:02.016026 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-824c4a4d-4340-4a78-82d4-d3f2eb24c721 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:02.016471 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-824c4a4d-4340-4a78-82d4-d3f2eb24c721 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:02.017232 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-824c4a4d-4340-4a78-82d4-d3f2eb24c721 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:02.017668 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-824c4a4d-4340-4a78-82d4-d3f2eb24c721 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:02.041832 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-824c4a4d-4340-4a78-82d4-d3f2eb24c721 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] [instance: dc183ff4-10bd-4827-a6a8-17f6b6d739be] Going to try to terminate instance {{(pid=124867) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 10:50:02.384468 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-015a9566-31f7-41ac-a242-004ef20c259a tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:02.385080 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-015a9566-31f7-41ac-a242-004ef20c259a tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:02.392065 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-824c4a4d-4340-4a78-82d4-d3f2eb24c721 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] 10.222.0.48 "DELETE /compute/v2.1/servers/dc183ff4-10bd-4827-a6a8-17f6b6d739be" status: 204 len: 0 microversion: 2.1 time: 0.386651 Jul 21 10:50:02.394474 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell0:SELECT=12 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:50:02.397238 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-015a9566-31f7-41ac-a242-004ef20c259a tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:02.397738 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-015a9566-31f7-41ac-a242-004ef20c259a tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:02.398472 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-015a9566-31f7-41ac-a242-004ef20c259a tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:02.398939 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-015a9566-31f7-41ac-a242-004ef20c259a tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:02.403246 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 231/441] 10.222.0.48 () {58 vars in 1238 bytes} [Thu Jul 21 10:50:02 2022] DELETE /compute/v2.1/servers/dc183ff4-10bd-4827-a6a8-17f6b6d739be => generated 0 bytes in 399 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 10:50:02.411899 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-f2f96f8d-56f6-489b-8cf4-b10089ab6c39 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:02.412599 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-f2f96f8d-56f6-489b-8cf4-b10089ab6c39 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] [instance: dc183ff4-10bd-4827-a6a8-17f6b6d739be] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:02.419050 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f2f96f8d-56f6-489b-8cf4-b10089ab6c39 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:02.419492 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f2f96f8d-56f6-489b-8cf4-b10089ab6c39 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:02.420286 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f2f96f8d-56f6-489b-8cf4-b10089ab6c39 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:02.420719 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f2f96f8d-56f6-489b-8cf4-b10089ab6c39 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:02.607517 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-015a9566-31f7-41ac-a242-004ef20c259a tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:02.614379 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-f2f96f8d-56f6-489b-8cf4-b10089ab6c39 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ccc2d61c7045a8abba95e7cd002a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24d5a2477eb74d5da5911b37f9031110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:02.615923 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-015a9566-31f7-41ac-a242-004ef20c259a tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:02.617445 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-015a9566-31f7-41ac-a242-004ef20c259a tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:02.618631 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-015a9566-31f7-41ac-a242-004ef20c259a tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1808 microversion: 2.20 time: 0.238538 Jul 21 10:50:02.619191 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 211/442] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:50:02 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1808 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 10:50:02.622984 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-f2f96f8d-56f6-489b-8cf4-b10089ab6c39 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] 10.222.0.48 "GET /compute/v2.1/servers/dc183ff4-10bd-4827-a6a8-17f6b6d739be" status: 200 len: 1514 microversion: 2.1 time: 0.215145 Jul 21 10:50:02.624045 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 232/443] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:02 2022] GET /compute/v2.1/servers/dc183ff4-10bd-4827-a6a8-17f6b6d739be => generated 1514 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:50:02.624159 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-ee80f026-dc90-46ff-9cf6-f5de5d823ce2 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:02.626094 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-ee80f026-dc90-46ff-9cf6-f5de5d823ce2 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] [instance: eb24f843-eeb3-43dd-bd48-3bcf68e344cd] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:02.632011 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-52abc1a3-cad9-45cd-a807-405639be5482 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:02.632613 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-52abc1a3-cad9-45cd-a807-405639be5482 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] [instance: 6597f555-38e1-4d14-bf7c-6d8b5e5a26d4] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:02.639217 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ee80f026-dc90-46ff-9cf6-f5de5d823ce2 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:02.639605 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ee80f026-dc90-46ff-9cf6-f5de5d823ce2 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:02.639721 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-52abc1a3-cad9-45cd-a807-405639be5482 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:02.640208 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-52abc1a3-cad9-45cd-a807-405639be5482 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:02.640377 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ee80f026-dc90-46ff-9cf6-f5de5d823ce2 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:02.640814 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ee80f026-dc90-46ff-9cf6-f5de5d823ce2 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:02.640970 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-52abc1a3-cad9-45cd-a807-405639be5482 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:02.641406 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-52abc1a3-cad9-45cd-a807-405639be5482 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:02.728337 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-52abc1a3-cad9-45cd-a807-405639be5482 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0271efe4b4e9592b29d9f124519b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eff05785bd84522ad637d8bed14563d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:02.736490 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-52abc1a3-cad9-45cd-a807-405639be5482 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] 10.222.0.48 "GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4" status: 200 len: 1318 microversion: 2.1 time: 0.107966 Jul 21 10:50:02.737072 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 233/444] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:02 2022] GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4 => generated 1318 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:50:02.800928 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-ee80f026-dc90-46ff-9cf6-f5de5d823ce2 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e3fd195fd14b009ba56950dc542cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620ea9c4eaa74dc5858cf93d9fcad9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:02.808972 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-ee80f026-dc90-46ff-9cf6-f5de5d823ce2 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] 10.222.0.48 "GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd" status: 200 len: 1260 microversion: 2.1 time: 0.188683 Jul 21 10:50:02.809542 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 212/445] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:02 2022] GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd => generated 1260 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:50:03.638867 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-ec62ede9-83a6-40fd-aee0-e30a78c33fe1 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:03.639472 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-ec62ede9-83a6-40fd-aee0-e30a78c33fe1 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:03.640962 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-7cb41e5e-85f3-4cf5-a392-5c5694078270 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:03.641388 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell0:SELECT=2 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:50:03.641562 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-7cb41e5e-85f3-4cf5-a392-5c5694078270 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] [instance: dc183ff4-10bd-4827-a6a8-17f6b6d739be] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:03.644409 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=4 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:50:03.646451 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ec62ede9-83a6-40fd-aee0-e30a78c33fe1 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:03.647039 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ec62ede9-83a6-40fd-aee0-e30a78c33fe1 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:03.647823 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ec62ede9-83a6-40fd-aee0-e30a78c33fe1 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:03.648261 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ec62ede9-83a6-40fd-aee0-e30a78c33fe1 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:03.648988 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7cb41e5e-85f3-4cf5-a392-5c5694078270 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:03.649439 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7cb41e5e-85f3-4cf5-a392-5c5694078270 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:03.650198 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7cb41e5e-85f3-4cf5-a392-5c5694078270 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:03.650858 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7cb41e5e-85f3-4cf5-a392-5c5694078270 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:03.848826 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-ec62ede9-83a6-40fd-aee0-e30a78c33fe1 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:03.851969 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-7cb41e5e-85f3-4cf5-a392-5c5694078270 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ccc2d61c7045a8abba95e7cd002a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24d5a2477eb74d5da5911b37f9031110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:03.866989 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-7cb41e5e-85f3-4cf5-a392-5c5694078270 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] 10.222.0.48 "GET /compute/v2.1/servers/dc183ff4-10bd-4827-a6a8-17f6b6d739be" status: 200 len: 1514 microversion: 2.1 time: 0.230453 Jul 21 10:50:03.870532 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-ec62ede9-83a6-40fd-aee0-e30a78c33fe1 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:03.872206 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-ec62ede9-83a6-40fd-aee0-e30a78c33fe1 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:03.873494 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-ec62ede9-83a6-40fd-aee0-e30a78c33fe1 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1808 microversion: 2.20 time: 0.239557 Jul 21 10:50:03.874051 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 234/446] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:50:03 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1808 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:50:03.874988 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 213/447] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:03 2022] GET /compute/v2.1/servers/dc183ff4-10bd-4827-a6a8-17f6b6d739be => generated 1514 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:50:03.883512 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-2e1ac6a6-baa4-4e7e-96f5-e0785da5af80 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:03.884126 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-2e1ac6a6-baa4-4e7e-96f5-e0785da5af80 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] [instance: 6597f555-38e1-4d14-bf7c-6d8b5e5a26d4] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:03.885308 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-6bfe916d-1e70-4a41-a119-2a3075255cbc tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:03.886258 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-6bfe916d-1e70-4a41-a119-2a3075255cbc tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] [instance: eb24f843-eeb3-43dd-bd48-3bcf68e344cd] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:03.895319 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6bfe916d-1e70-4a41-a119-2a3075255cbc tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:03.896009 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6bfe916d-1e70-4a41-a119-2a3075255cbc tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:03.897113 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6bfe916d-1e70-4a41-a119-2a3075255cbc tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:03.897240 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2e1ac6a6-baa4-4e7e-96f5-e0785da5af80 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:03.897968 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2e1ac6a6-baa4-4e7e-96f5-e0785da5af80 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:03.898115 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6bfe916d-1e70-4a41-a119-2a3075255cbc tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:03.898779 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2e1ac6a6-baa4-4e7e-96f5-e0785da5af80 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:03.899218 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2e1ac6a6-baa4-4e7e-96f5-e0785da5af80 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:03.996581 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-2e1ac6a6-baa4-4e7e-96f5-e0785da5af80 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0271efe4b4e9592b29d9f124519b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eff05785bd84522ad637d8bed14563d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:03.999007 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:50:04.005455 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-2e1ac6a6-baa4-4e7e-96f5-e0785da5af80 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] 10.222.0.48 "GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4" status: 200 len: 1318 microversion: 2.1 time: 0.130409 Jul 21 10:50:04.006128 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 235/448] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:03 2022] GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4 => generated 1318 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:50:04.068235 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-6bfe916d-1e70-4a41-a119-2a3075255cbc tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e3fd195fd14b009ba56950dc542cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620ea9c4eaa74dc5858cf93d9fcad9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:04.073274 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-6bfe916d-1e70-4a41-a119-2a3075255cbc tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] 10.222.0.48 "GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd" status: 200 len: 1260 microversion: 2.1 time: 0.197251 Jul 21 10:50:04.073871 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 214/449] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:03 2022] GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd => generated 1260 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:50:04.884037 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-fb33ce4a-abce-4b18-a89b-240bfc079c4e tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:04.884660 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-fb33ce4a-abce-4b18-a89b-240bfc079c4e tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] [instance: dc183ff4-10bd-4827-a6a8-17f6b6d739be] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:04.886980 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell0:SELECT=12 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:50:04.892597 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fb33ce4a-abce-4b18-a89b-240bfc079c4e tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:04.893059 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fb33ce4a-abce-4b18-a89b-240bfc079c4e tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:04.893894 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fb33ce4a-abce-4b18-a89b-240bfc079c4e tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:04.894348 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fb33ce4a-abce-4b18-a89b-240bfc079c4e tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:04.895468 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-6d58eb3d-faf7-4549-bcd5-c103639184ff tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:04.896145 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-6d58eb3d-faf7-4549-bcd5-c103639184ff tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:04.903116 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6d58eb3d-faf7-4549-bcd5-c103639184ff tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:04.903589 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6d58eb3d-faf7-4549-bcd5-c103639184ff tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:04.904806 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6d58eb3d-faf7-4549-bcd5-c103639184ff tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:04.905240 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6d58eb3d-faf7-4549-bcd5-c103639184ff tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:05.142034 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-fb33ce4a-abce-4b18-a89b-240bfc079c4e tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ccc2d61c7045a8abba95e7cd002a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24d5a2477eb74d5da5911b37f9031110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:05.154288 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-6d58eb3d-faf7-4549-bcd5-c103639184ff tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:05.155683 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-fb33ce4a-abce-4b18-a89b-240bfc079c4e tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] 10.222.0.48 "GET /compute/v2.1/servers/dc183ff4-10bd-4827-a6a8-17f6b6d739be" status: 200 len: 1514 microversion: 2.1 time: 0.275546 Jul 21 10:50:05.156891 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 236/450] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:04 2022] GET /compute/v2.1/servers/dc183ff4-10bd-4827-a6a8-17f6b6d739be => generated 1514 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:50:05.166215 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-54843682-8274-480b-964a-c82efbbf665e tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:05.167278 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-54843682-8274-480b-964a-c82efbbf665e tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] [instance: 6597f555-38e1-4d14-bf7c-6d8b5e5a26d4] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:05.176500 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-6d58eb3d-faf7-4549-bcd5-c103639184ff tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:05.178667 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-6d58eb3d-faf7-4549-bcd5-c103639184ff tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:05.181737 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-54843682-8274-480b-964a-c82efbbf665e tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:05.182572 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-54843682-8274-480b-964a-c82efbbf665e tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:05.183515 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-6d58eb3d-faf7-4549-bcd5-c103639184ff tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1808 microversion: 2.20 time: 0.291795 Jul 21 10:50:05.184974 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 215/451] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:50:04 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1808 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 10:50:05.185463 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-54843682-8274-480b-964a-c82efbbf665e tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:05.186051 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-54843682-8274-480b-964a-c82efbbf665e tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:05.192510 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-5555db13-97af-45a7-b00e-adedb75e3bde tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:05.199621 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-5555db13-97af-45a7-b00e-adedb75e3bde tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] [instance: eb24f843-eeb3-43dd-bd48-3bcf68e344cd] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:05.207367 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5555db13-97af-45a7-b00e-adedb75e3bde tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:05.208343 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5555db13-97af-45a7-b00e-adedb75e3bde tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:05.209411 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5555db13-97af-45a7-b00e-adedb75e3bde tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:05.210062 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5555db13-97af-45a7-b00e-adedb75e3bde tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:05.482411 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-54843682-8274-480b-964a-c82efbbf665e tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0271efe4b4e9592b29d9f124519b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eff05785bd84522ad637d8bed14563d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:05.495304 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-54843682-8274-480b-964a-c82efbbf665e tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] 10.222.0.48 "GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4" status: 200 len: 1358 microversion: 2.1 time: 0.336593 Jul 21 10:50:05.505527 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 237/452] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:05 2022] GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4 => generated 1358 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:50:05.520779 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-5555db13-97af-45a7-b00e-adedb75e3bde tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e3fd195fd14b009ba56950dc542cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620ea9c4eaa74dc5858cf93d9fcad9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:05.530188 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-5555db13-97af-45a7-b00e-adedb75e3bde tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] 10.222.0.48 "GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd" status: 200 len: 1260 microversion: 2.1 time: 0.343182 Jul 21 10:50:05.530838 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 216/453] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:05 2022] GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd => generated 1260 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:50:05.802882 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [req-a18b0147-6779-4544-aa75-39e4af0cb2c9 req-89e70df6-9756-41ad-bba0-1bd2c5685268 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc183ff4-10bd-4827-a6a8-17f6b6d739be", "name": "network-vif-deleted", "tag": "87f2bea1-63ad-4eba-8841-1dd79129258c"}]} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:50:05.812639 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-a18b0147-6779-4544-aa75-39e4af0cb2c9 req-89e70df6-9756-41ad-bba0-1bd2c5685268 service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:05.813070 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-a18b0147-6779-4544-aa75-39e4af0cb2c9 req-89e70df6-9756-41ad-bba0-1bd2c5685268 service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:05.829177 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.compute.server_external_events [req-a18b0147-6779-4544-aa75-39e4af0cb2c9 req-89e70df6-9756-41ad-bba0-1bd2c5685268 service nova] Creating event network-vif-deleted:87f2bea1-63ad-4eba-8841-1dd79129258c for instance dc183ff4-10bd-4827-a6a8-17f6b6d739be on hv-cinder-84980 Jul 21 10:50:05.839492 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [req-a18b0147-6779-4544-aa75-39e4af0cb2c9 req-89e70df6-9756-41ad-bba0-1bd2c5685268 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040657 Jul 21 10:50:05.842124 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 238/454] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 21 10:50:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:50:06.130764 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-fe49297f-49b5-4976-afa3-7d8a6afe2a44 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:50:06.132370 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-fe49297f-49b5-4976-afa3-7d8a6afe2a44 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: a54643be-3f53-4fe5-bab0-786b71d627bb] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:06.140101 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-fe49297f-49b5-4976-afa3-7d8a6afe2a44 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:06.140552 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-fe49297f-49b5-4976-afa3-7d8a6afe2a44 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:06.141599 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-fe49297f-49b5-4976-afa3-7d8a6afe2a44 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:06.142269 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-fe49297f-49b5-4976-afa3-7d8a6afe2a44 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:06.171085 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.objects.instance [None req-fe49297f-49b5-4976-afa3-7d8a6afe2a44 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lazy-loading 'flavor' on Instance uuid a54643be-3f53-4fe5-bab0-786b71d627bb {{(pid=124868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 10:50:06.175327 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-12172280-a7b8-4a94-9e01-5438d8f7e03f tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:06.176218 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-12172280-a7b8-4a94-9e01-5438d8f7e03f tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] [instance: dc183ff4-10bd-4827-a6a8-17f6b6d739be] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:06.182779 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-12172280-a7b8-4a94-9e01-5438d8f7e03f tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:06.183426 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-12172280-a7b8-4a94-9e01-5438d8f7e03f tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:06.185042 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-12172280-a7b8-4a94-9e01-5438d8f7e03f tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:06.185762 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-12172280-a7b8-4a94-9e01-5438d8f7e03f tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:06.284883 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-12172280-a7b8-4a94-9e01-5438d8f7e03f tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ccc2d61c7045a8abba95e7cd002a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24d5a2477eb74d5da5911b37f9031110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:06.297811 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-12172280-a7b8-4a94-9e01-5438d8f7e03f tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] 10.222.0.48 "GET /compute/v2.1/servers/dc183ff4-10bd-4827-a6a8-17f6b6d739be" status: 200 len: 1472 microversion: 2.1 time: 0.126837 Jul 21 10:50:06.299870 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 239/455] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:06 2022] GET /compute/v2.1/servers/dc183ff4-10bd-4827-a6a8-17f6b6d739be => generated 1472 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:50:06.305406 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-7823f708-686f-4209-83cd-0f52863171e7 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:06.306242 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-7823f708-686f-4209-83cd-0f52863171e7 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:06.315752 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7823f708-686f-4209-83cd-0f52863171e7 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:06.316762 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7823f708-686f-4209-83cd-0f52863171e7 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:06.317983 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7823f708-686f-4209-83cd-0f52863171e7 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:06.318690 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7823f708-686f-4209-83cd-0f52863171e7 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:06.567556 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-7823f708-686f-4209-83cd-0f52863171e7 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:06.578048 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-7823f708-686f-4209-83cd-0f52863171e7 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:06.579629 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-7823f708-686f-4209-83cd-0f52863171e7 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:06.580795 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-7823f708-686f-4209-83cd-0f52863171e7 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1808 microversion: 2.20 time: 0.279743 Jul 21 10:50:06.586584 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 240/456] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:50:06 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1808 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:50:06.594212 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-63b19991-3635-49f1-9898-2d82703e63b0 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:06.594212 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-63b19991-3635-49f1-9898-2d82703e63b0 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] [instance: 6597f555-38e1-4d14-bf7c-6d8b5e5a26d4] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:06.595356 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-63b19991-3635-49f1-9898-2d82703e63b0 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:06.595827 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-63b19991-3635-49f1-9898-2d82703e63b0 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:06.596758 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-63b19991-3635-49f1-9898-2d82703e63b0 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:06.597192 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-63b19991-3635-49f1-9898-2d82703e63b0 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:06.649935 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-fe49297f-49b5-4976-afa3-7d8a6afe2a44 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "POST /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb/action" status: 200 len: 32 microversion: 2.1 time: 0.523220 Jul 21 10:50:06.656037 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 217/457] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 21 10:50:06 2022] POST /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb/action => generated 32 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 21 10:50:06.661531 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-17eb8b46-0fbc-48f5-bfa7-bdb738578dca tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:06.663100 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-17eb8b46-0fbc-48f5-bfa7-bdb738578dca tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] [instance: eb24f843-eeb3-43dd-bd48-3bcf68e344cd] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:06.672217 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-17eb8b46-0fbc-48f5-bfa7-bdb738578dca tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:06.672546 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-17eb8b46-0fbc-48f5-bfa7-bdb738578dca tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:06.675663 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-17eb8b46-0fbc-48f5-bfa7-bdb738578dca tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:06.676466 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-17eb8b46-0fbc-48f5-bfa7-bdb738578dca tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:06.839827 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-63b19991-3635-49f1-9898-2d82703e63b0 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0271efe4b4e9592b29d9f124519b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eff05785bd84522ad637d8bed14563d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:06.850651 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-63b19991-3635-49f1-9898-2d82703e63b0 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] 10.222.0.48 "GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4" status: 200 len: 1358 microversion: 2.1 time: 0.266735 Jul 21 10:50:06.851795 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 241/458] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:06 2022] GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4 => generated 1358 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:50:06.858667 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-c5cab279-e83d-450e-901a-3e0ec9dff731 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:06.859420 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-c5cab279-e83d-450e-901a-3e0ec9dff731 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: a54643be-3f53-4fe5-bab0-786b71d627bb] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:06.870143 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c5cab279-e83d-450e-901a-3e0ec9dff731 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:06.870948 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c5cab279-e83d-450e-901a-3e0ec9dff731 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:06.872291 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c5cab279-e83d-450e-901a-3e0ec9dff731 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:06.873046 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c5cab279-e83d-450e-901a-3e0ec9dff731 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:06.913287 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-17eb8b46-0fbc-48f5-bfa7-bdb738578dca tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e3fd195fd14b009ba56950dc542cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620ea9c4eaa74dc5858cf93d9fcad9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:06.921875 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-17eb8b46-0fbc-48f5-bfa7-bdb738578dca tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] 10.222.0.48 "GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd" status: 200 len: 1260 microversion: 2.1 time: 0.264470 Jul 21 10:50:06.930585 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 218/459] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:06 2022] GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd => generated 1260 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:50:07.078096 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-c5cab279-e83d-450e-901a-3e0ec9dff731 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:07.087326 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-c5cab279-e83d-450e-901a-3e0ec9dff731 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb" status: 200 len: 1736 microversion: 2.1 time: 0.234318 Jul 21 10:50:07.087923 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 242/460] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:06 2022] GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb => generated 1736 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:50:07.315992 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-c19be6da-1453-4879-9a41-5fa3f1579c5b tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:07.316800 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-c19be6da-1453-4879-9a41-5fa3f1579c5b tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] [instance: dc183ff4-10bd-4827-a6a8-17f6b6d739be] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:07.323442 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c19be6da-1453-4879-9a41-5fa3f1579c5b tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:07.323881 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c19be6da-1453-4879-9a41-5fa3f1579c5b tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:07.325414 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c19be6da-1453-4879-9a41-5fa3f1579c5b tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:07.325863 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c19be6da-1453-4879-9a41-5fa3f1579c5b tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:07.397769 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-c19be6da-1453-4879-9a41-5fa3f1579c5b tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ccc2d61c7045a8abba95e7cd002a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24d5a2477eb74d5da5911b37f9031110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:07.406109 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-c19be6da-1453-4879-9a41-5fa3f1579c5b tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] 10.222.0.48 "GET /compute/v2.1/servers/dc183ff4-10bd-4827-a6a8-17f6b6d739be" status: 200 len: 1472 microversion: 2.1 time: 0.094002 Jul 21 10:50:07.406816 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 219/461] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:07 2022] GET /compute/v2.1/servers/dc183ff4-10bd-4827-a6a8-17f6b6d739be => generated 1472 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:50:07.600989 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-2270da1f-40eb-4fbf-98ff-19d9c2df483a tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:07.601558 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-2270da1f-40eb-4fbf-98ff-19d9c2df483a tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:07.608505 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2270da1f-40eb-4fbf-98ff-19d9c2df483a tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:07.609794 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2270da1f-40eb-4fbf-98ff-19d9c2df483a tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:07.611194 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2270da1f-40eb-4fbf-98ff-19d9c2df483a tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:07.611782 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2270da1f-40eb-4fbf-98ff-19d9c2df483a tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:07.803006 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-2270da1f-40eb-4fbf-98ff-19d9c2df483a tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:07.812815 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-2270da1f-40eb-4fbf-98ff-19d9c2df483a tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:07.816273 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-2270da1f-40eb-4fbf-98ff-19d9c2df483a tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:07.816273 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-2270da1f-40eb-4fbf-98ff-19d9c2df483a tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1808 microversion: 2.20 time: 0.218338 Jul 21 10:50:07.816273 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 243/462] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:50:07 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1808 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:50:07.869716 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-9700c552-ee26-49dd-937d-54e5b8364e13 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:07.870831 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-9700c552-ee26-49dd-937d-54e5b8364e13 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] [instance: 6597f555-38e1-4d14-bf7c-6d8b5e5a26d4] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:07.873713 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [req-01974776-ca88-493d-b6c7-339f55a5b802 req-d3d85c37-c5ce-49e0-8517-edc863811f2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6597f555-38e1-4d14-bf7c-6d8b5e5a26d4", "tag": "24113ecd-45f8-473c-a1aa-fc93cff6c402"}]} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:50:07.878777 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9700c552-ee26-49dd-937d-54e5b8364e13 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:07.880371 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9700c552-ee26-49dd-937d-54e5b8364e13 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:07.881367 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9700c552-ee26-49dd-937d-54e5b8364e13 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:07.881883 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-01974776-ca88-493d-b6c7-339f55a5b802 req-d3d85c37-c5ce-49e0-8517-edc863811f2b service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:07.882267 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9700c552-ee26-49dd-937d-54e5b8364e13 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:07.882378 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-01974776-ca88-493d-b6c7-339f55a5b802 req-d3d85c37-c5ce-49e0-8517-edc863811f2b service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:07.908468 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.compute.server_external_events [req-01974776-ca88-493d-b6c7-339f55a5b802 req-d3d85c37-c5ce-49e0-8517-edc863811f2b service nova] Creating event network-changed:24113ecd-45f8-473c-a1aa-fc93cff6c402 for instance 6597f555-38e1-4d14-bf7c-6d8b5e5a26d4 on hv-cinder-84980 Jul 21 10:50:07.913218 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [req-01974776-ca88-493d-b6c7-339f55a5b802 req-d3d85c37-c5ce-49e0-8517-edc863811f2b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043495 Jul 21 10:50:07.914235 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 244/463] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 21 10:50:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 10:50:07.940072 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-86eeb017-8df0-4446-bc1f-d5b7a578a20f tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:07.940778 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-86eeb017-8df0-4446-bc1f-d5b7a578a20f tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] [instance: eb24f843-eeb3-43dd-bd48-3bcf68e344cd] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:07.947360 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-86eeb017-8df0-4446-bc1f-d5b7a578a20f tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:07.947807 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-86eeb017-8df0-4446-bc1f-d5b7a578a20f tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:07.948574 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-86eeb017-8df0-4446-bc1f-d5b7a578a20f tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:07.949004 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-86eeb017-8df0-4446-bc1f-d5b7a578a20f tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:08.104044 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-9700c552-ee26-49dd-937d-54e5b8364e13 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0271efe4b4e9592b29d9f124519b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eff05785bd84522ad637d8bed14563d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:08.106628 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:50:08.119224 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-9700c552-ee26-49dd-937d-54e5b8364e13 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] 10.222.0.48 "GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4" status: 200 len: 1358 microversion: 2.1 time: 0.248578 Jul 21 10:50:08.119224 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 220/464] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:07 2022] GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4 => generated 1358 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:50:08.123742 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-982f07e3-5b1a-45c8-8b0c-953cefe162f9 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:08.124363 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-982f07e3-5b1a-45c8-8b0c-953cefe162f9 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: a54643be-3f53-4fe5-bab0-786b71d627bb] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:08.130709 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-982f07e3-5b1a-45c8-8b0c-953cefe162f9 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:08.131170 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-982f07e3-5b1a-45c8-8b0c-953cefe162f9 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:08.132114 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-982f07e3-5b1a-45c8-8b0c-953cefe162f9 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:08.132680 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-982f07e3-5b1a-45c8-8b0c-953cefe162f9 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:08.133463 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-86eeb017-8df0-4446-bc1f-d5b7a578a20f tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e3fd195fd14b009ba56950dc542cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620ea9c4eaa74dc5858cf93d9fcad9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:08.145100 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-86eeb017-8df0-4446-bc1f-d5b7a578a20f tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] 10.222.0.48 "GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd" status: 200 len: 1260 microversion: 2.1 time: 0.209213 Jul 21 10:50:08.145804 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 245/465] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:07 2022] GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd => generated 1260 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:50:08.267961 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-982f07e3-5b1a-45c8-8b0c-953cefe162f9 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:08.275828 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-982f07e3-5b1a-45c8-8b0c-953cefe162f9 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb" status: 200 len: 1736 microversion: 2.1 time: 0.160993 Jul 21 10:50:08.276394 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 221/466] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:08 2022] GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:50:08.423160 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-a657dbe7-4a98-48e2-94fd-e05a759d372c tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:08.423765 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-a657dbe7-4a98-48e2-94fd-e05a759d372c tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] [instance: dc183ff4-10bd-4827-a6a8-17f6b6d739be] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:08.429752 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a657dbe7-4a98-48e2-94fd-e05a759d372c tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:08.430196 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a657dbe7-4a98-48e2-94fd-e05a759d372c tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:08.430981 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a657dbe7-4a98-48e2-94fd-e05a759d372c tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:08.431408 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a657dbe7-4a98-48e2-94fd-e05a759d372c tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:08.492476 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-a657dbe7-4a98-48e2-94fd-e05a759d372c tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ccc2d61c7045a8abba95e7cd002a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24d5a2477eb74d5da5911b37f9031110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:08.500776 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-a657dbe7-4a98-48e2-94fd-e05a759d372c tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] 10.222.0.48 "GET /compute/v2.1/servers/dc183ff4-10bd-4827-a6a8-17f6b6d739be" status: 200 len: 1472 microversion: 2.1 time: 0.082058 Jul 21 10:50:08.501326 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 246/467] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:08 2022] GET /compute/v2.1/servers/dc183ff4-10bd-4827-a6a8-17f6b6d739be => generated 1472 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:50:08.833361 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-dedec056-53cb-4de0-990e-5b5d1a637810 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:08.834013 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-dedec056-53cb-4de0-990e-5b5d1a637810 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:08.841639 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-dedec056-53cb-4de0-990e-5b5d1a637810 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:08.842122 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-dedec056-53cb-4de0-990e-5b5d1a637810 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:08.843183 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-dedec056-53cb-4de0-990e-5b5d1a637810 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:08.843619 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-dedec056-53cb-4de0-990e-5b5d1a637810 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:08.977313 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-dedec056-53cb-4de0-990e-5b5d1a637810 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:08.987370 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-dedec056-53cb-4de0-990e-5b5d1a637810 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:08.989236 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-dedec056-53cb-4de0-990e-5b5d1a637810 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:08.990568 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-dedec056-53cb-4de0-990e-5b5d1a637810 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1808 microversion: 2.20 time: 0.161129 Jul 21 10:50:09.003966 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 222/468] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:50:08 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:50:09.131485 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-903d65d0-5083-4ed1-8476-e29b7bddbd2b tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:09.132254 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-903d65d0-5083-4ed1-8476-e29b7bddbd2b tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] [instance: 6597f555-38e1-4d14-bf7c-6d8b5e5a26d4] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:09.144085 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-903d65d0-5083-4ed1-8476-e29b7bddbd2b tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:09.144629 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-903d65d0-5083-4ed1-8476-e29b7bddbd2b tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:09.145641 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-903d65d0-5083-4ed1-8476-e29b7bddbd2b tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:09.146146 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-903d65d0-5083-4ed1-8476-e29b7bddbd2b tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:09.175363 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-0fc783bd-a574-4e94-b576-fbfc00cc8fde tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:09.176240 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-0fc783bd-a574-4e94-b576-fbfc00cc8fde tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] [instance: eb24f843-eeb3-43dd-bd48-3bcf68e344cd] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:09.192205 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0fc783bd-a574-4e94-b576-fbfc00cc8fde tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:09.192205 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0fc783bd-a574-4e94-b576-fbfc00cc8fde tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:09.192205 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0fc783bd-a574-4e94-b576-fbfc00cc8fde tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:09.195212 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0fc783bd-a574-4e94-b576-fbfc00cc8fde tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:09.390248 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-903d65d0-5083-4ed1-8476-e29b7bddbd2b tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0271efe4b4e9592b29d9f124519b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eff05785bd84522ad637d8bed14563d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:09.399191 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-903d65d0-5083-4ed1-8476-e29b7bddbd2b tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] 10.222.0.48 "GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4" status: 200 len: 1358 microversion: 2.1 time: 0.272722 Jul 21 10:50:09.400799 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-0fc783bd-a574-4e94-b576-fbfc00cc8fde tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e3fd195fd14b009ba56950dc542cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620ea9c4eaa74dc5858cf93d9fcad9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:09.409945 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-0fc783bd-a574-4e94-b576-fbfc00cc8fde tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] 10.222.0.48 "GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd" status: 200 len: 1260 microversion: 2.1 time: 0.244438 Jul 21 10:50:09.413558 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 247/469] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:09 2022] GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4 => generated 1358 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:50:09.418492 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-dbdb9b0a-cc03-495c-bfe3-309c9576335b tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:09.419729 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-dbdb9b0a-cc03-495c-bfe3-309c9576335b tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: a54643be-3f53-4fe5-bab0-786b71d627bb] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:09.420446 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 223/470] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:09 2022] GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd => generated 1260 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:50:09.427386 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-dbdb9b0a-cc03-495c-bfe3-309c9576335b tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:09.427847 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-dbdb9b0a-cc03-495c-bfe3-309c9576335b tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:09.428623 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-dbdb9b0a-cc03-495c-bfe3-309c9576335b tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:09.429085 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-dbdb9b0a-cc03-495c-bfe3-309c9576335b tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:09.517625 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-881f1e64-650e-4c6c-86eb-d82b6b84f520 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:09.518228 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-881f1e64-650e-4c6c-86eb-d82b6b84f520 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] [instance: dc183ff4-10bd-4827-a6a8-17f6b6d739be] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:09.524277 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-881f1e64-650e-4c6c-86eb-d82b6b84f520 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:09.524724 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-881f1e64-650e-4c6c-86eb-d82b6b84f520 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:09.525495 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-881f1e64-650e-4c6c-86eb-d82b6b84f520 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:09.525924 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-881f1e64-650e-4c6c-86eb-d82b6b84f520 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:09.598565 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-881f1e64-650e-4c6c-86eb-d82b6b84f520 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ccc2d61c7045a8abba95e7cd002a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24d5a2477eb74d5da5911b37f9031110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:09.603048 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-dbdb9b0a-cc03-495c-bfe3-309c9576335b tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:09.606110 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-881f1e64-650e-4c6c-86eb-d82b6b84f520 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] 10.222.0.48 "GET /compute/v2.1/servers/dc183ff4-10bd-4827-a6a8-17f6b6d739be" status: 200 len: 1472 microversion: 2.1 time: 0.092244 Jul 21 10:50:09.606715 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 224/471] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:09 2022] GET /compute/v2.1/servers/dc183ff4-10bd-4827-a6a8-17f6b6d739be => generated 1472 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:50:09.611549 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-dbdb9b0a-cc03-495c-bfe3-309c9576335b tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb" status: 200 len: 1736 microversion: 2.1 time: 0.196848 Jul 21 10:50:09.613187 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 248/472] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:09 2022] GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb => generated 1736 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:50:10.011689 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-8fd9a8d8-80a3-4af0-abff-55b72f8e95f1 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:10.012302 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-8fd9a8d8-80a3-4af0-abff-55b72f8e95f1 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:10.019175 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8fd9a8d8-80a3-4af0-abff-55b72f8e95f1 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:10.019626 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8fd9a8d8-80a3-4af0-abff-55b72f8e95f1 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:10.020390 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8fd9a8d8-80a3-4af0-abff-55b72f8e95f1 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:10.020832 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8fd9a8d8-80a3-4af0-abff-55b72f8e95f1 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:10.176130 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-8fd9a8d8-80a3-4af0-abff-55b72f8e95f1 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:10.185554 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-8fd9a8d8-80a3-4af0-abff-55b72f8e95f1 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:10.187836 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-8fd9a8d8-80a3-4af0-abff-55b72f8e95f1 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:10.189086 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-8fd9a8d8-80a3-4af0-abff-55b72f8e95f1 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1808 microversion: 2.20 time: 0.180772 Jul 21 10:50:10.199424 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 225/473] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:50:10 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1808 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 10:50:10.421650 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-cc626fa7-a469-4ccd-9b72-ddac8fed0a79 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:10.422255 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-cc626fa7-a469-4ccd-9b72-ddac8fed0a79 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] [instance: 6597f555-38e1-4d14-bf7c-6d8b5e5a26d4] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:10.426467 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-1033f889-2733-46b0-ac0f-c48e4b0333d6 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:10.427458 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-1033f889-2733-46b0-ac0f-c48e4b0333d6 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] [instance: eb24f843-eeb3-43dd-bd48-3bcf68e344cd] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:10.428558 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-cc626fa7-a469-4ccd-9b72-ddac8fed0a79 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:10.429052 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-cc626fa7-a469-4ccd-9b72-ddac8fed0a79 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:10.429830 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-cc626fa7-a469-4ccd-9b72-ddac8fed0a79 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:10.430373 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-cc626fa7-a469-4ccd-9b72-ddac8fed0a79 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:10.444334 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1033f889-2733-46b0-ac0f-c48e4b0333d6 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:10.444792 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1033f889-2733-46b0-ac0f-c48e4b0333d6 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:10.445625 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1033f889-2733-46b0-ac0f-c48e4b0333d6 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:10.446148 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1033f889-2733-46b0-ac0f-c48e4b0333d6 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:10.638302 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-1033f889-2733-46b0-ac0f-c48e4b0333d6 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e3fd195fd14b009ba56950dc542cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620ea9c4eaa74dc5858cf93d9fcad9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:10.653736 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-1033f889-2733-46b0-ac0f-c48e4b0333d6 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] 10.222.0.48 "GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd" status: 200 len: 1260 microversion: 2.1 time: 0.224191 Jul 21 10:50:10.658886 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 226/474] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:10 2022] GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd => generated 1260 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:50:10.664314 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-3300c457-34bf-4ec8-958a-dea5e4939bc0 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:10.665871 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-3300c457-34bf-4ec8-958a-dea5e4939bc0 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] [instance: dc183ff4-10bd-4827-a6a8-17f6b6d739be] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:10.670056 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-cc626fa7-a469-4ccd-9b72-ddac8fed0a79 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0271efe4b4e9592b29d9f124519b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eff05785bd84522ad637d8bed14563d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:10.673621 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3300c457-34bf-4ec8-958a-dea5e4939bc0 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:10.673992 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3300c457-34bf-4ec8-958a-dea5e4939bc0 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:10.674798 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3300c457-34bf-4ec8-958a-dea5e4939bc0 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:10.675240 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3300c457-34bf-4ec8-958a-dea5e4939bc0 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:10.683515 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-cc626fa7-a469-4ccd-9b72-ddac8fed0a79 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] 10.222.0.48 "GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4" status: 200 len: 1358 microversion: 2.1 time: 0.265193 Jul 21 10:50:10.684116 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 249/475] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:10 2022] GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4 => generated 1358 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:50:10.695017 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-b018ce09-0b49-48da-b8eb-b85ee26c4761 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:10.696307 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-b018ce09-0b49-48da-b8eb-b85ee26c4761 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: a54643be-3f53-4fe5-bab0-786b71d627bb] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:10.712189 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b018ce09-0b49-48da-b8eb-b85ee26c4761 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:10.712435 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b018ce09-0b49-48da-b8eb-b85ee26c4761 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:10.715003 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b018ce09-0b49-48da-b8eb-b85ee26c4761 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:10.716263 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b018ce09-0b49-48da-b8eb-b85ee26c4761 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:10.771384 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-3300c457-34bf-4ec8-958a-dea5e4939bc0 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ccc2d61c7045a8abba95e7cd002a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24d5a2477eb74d5da5911b37f9031110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:10.784835 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-3300c457-34bf-4ec8-958a-dea5e4939bc0 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] 10.222.0.48 "GET /compute/v2.1/servers/dc183ff4-10bd-4827-a6a8-17f6b6d739be" status: 200 len: 1472 microversion: 2.1 time: 0.124725 Jul 21 10:50:10.786004 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 227/476] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:10 2022] GET /compute/v2.1/servers/dc183ff4-10bd-4827-a6a8-17f6b6d739be => generated 1472 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:50:10.897156 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-b018ce09-0b49-48da-b8eb-b85ee26c4761 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:10.909601 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-b018ce09-0b49-48da-b8eb-b85ee26c4761 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb" status: 200 len: 1736 microversion: 2.1 time: 0.222759 Jul 21 10:50:10.910483 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 250/477] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:10 2022] GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb => generated 1736 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:50:11.210517 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-e6b0e8a4-16b8-4685-af37-5890bebcbe2a tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:11.211249 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-e6b0e8a4-16b8-4685-af37-5890bebcbe2a tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:11.220384 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e6b0e8a4-16b8-4685-af37-5890bebcbe2a tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:11.220839 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e6b0e8a4-16b8-4685-af37-5890bebcbe2a tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:11.221699 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e6b0e8a4-16b8-4685-af37-5890bebcbe2a tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:11.222213 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e6b0e8a4-16b8-4685-af37-5890bebcbe2a tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:11.380385 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-e6b0e8a4-16b8-4685-af37-5890bebcbe2a tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:11.389568 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-e6b0e8a4-16b8-4685-af37-5890bebcbe2a tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:11.391178 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-e6b0e8a4-16b8-4685-af37-5890bebcbe2a tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:11.392629 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-e6b0e8a4-16b8-4685-af37-5890bebcbe2a tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1808 microversion: 2.20 time: 0.187687 Jul 21 10:50:11.404164 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 228/478] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:50:11 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1808 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:50:11.671065 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-c369d19a-47e2-4233-8897-ac0f415aa223 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:11.671871 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-c369d19a-47e2-4233-8897-ac0f415aa223 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] [instance: eb24f843-eeb3-43dd-bd48-3bcf68e344cd] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:11.677694 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c369d19a-47e2-4233-8897-ac0f415aa223 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:11.678139 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c369d19a-47e2-4233-8897-ac0f415aa223 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:11.678920 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c369d19a-47e2-4233-8897-ac0f415aa223 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:11.679356 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c369d19a-47e2-4233-8897-ac0f415aa223 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:11.702066 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-51057237-fcec-4e46-8a3a-30a281e3713b tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:11.703582 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-51057237-fcec-4e46-8a3a-30a281e3713b tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] [instance: 6597f555-38e1-4d14-bf7c-6d8b5e5a26d4] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:11.713817 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-51057237-fcec-4e46-8a3a-30a281e3713b tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:11.716713 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-51057237-fcec-4e46-8a3a-30a281e3713b tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:11.717954 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-51057237-fcec-4e46-8a3a-30a281e3713b tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:11.719079 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-51057237-fcec-4e46-8a3a-30a281e3713b tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:11.919816 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-51057237-fcec-4e46-8a3a-30a281e3713b tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0271efe4b4e9592b29d9f124519b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eff05785bd84522ad637d8bed14563d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:11.924289 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-c369d19a-47e2-4233-8897-ac0f415aa223 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e3fd195fd14b009ba56950dc542cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620ea9c4eaa74dc5858cf93d9fcad9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:11.929473 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-51057237-fcec-4e46-8a3a-30a281e3713b tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] 10.222.0.48 "GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4" status: 200 len: 1358 microversion: 2.1 time: 0.232474 Jul 21 10:50:11.933897 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 229/479] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:11 2022] GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4 => generated 1358 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:50:11.934063 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-c369d19a-47e2-4233-8897-ac0f415aa223 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] 10.222.0.48 "GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd" status: 200 len: 1260 microversion: 2.1 time: 0.266932 Jul 21 10:50:11.935173 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 251/480] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:11 2022] GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd => generated 1260 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:50:11.938672 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-af357479-30aa-4314-a444-154c00c93cfe tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:11.939276 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-af357479-30aa-4314-a444-154c00c93cfe tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] [instance: dc183ff4-10bd-4827-a6a8-17f6b6d739be] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:11.940311 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-514c1f63-674f-41a6-8c16-5ebbb45a4701 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:11.941065 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-514c1f63-674f-41a6-8c16-5ebbb45a4701 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: a54643be-3f53-4fe5-bab0-786b71d627bb] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:11.945436 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-af357479-30aa-4314-a444-154c00c93cfe tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:11.945881 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-af357479-30aa-4314-a444-154c00c93cfe tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:11.946673 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-af357479-30aa-4314-a444-154c00c93cfe tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:11.947106 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-af357479-30aa-4314-a444-154c00c93cfe tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:11.948114 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-514c1f63-674f-41a6-8c16-5ebbb45a4701 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:11.948742 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-514c1f63-674f-41a6-8c16-5ebbb45a4701 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:11.950397 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-514c1f63-674f-41a6-8c16-5ebbb45a4701 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:11.950875 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-514c1f63-674f-41a6-8c16-5ebbb45a4701 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:12.061969 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-af357479-30aa-4314-a444-154c00c93cfe tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ccc2d61c7045a8abba95e7cd002a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24d5a2477eb74d5da5911b37f9031110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:12.069321 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-af357479-30aa-4314-a444-154c00c93cfe tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] 10.222.0.48 "GET /compute/v2.1/servers/dc183ff4-10bd-4827-a6a8-17f6b6d739be" status: 200 len: 1472 microversion: 2.1 time: 0.134367 Jul 21 10:50:12.070085 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 230/481] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:11 2022] GET /compute/v2.1/servers/dc183ff4-10bd-4827-a6a8-17f6b6d739be => generated 1472 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:50:12.129625 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-514c1f63-674f-41a6-8c16-5ebbb45a4701 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:12.138146 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-514c1f63-674f-41a6-8c16-5ebbb45a4701 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb" status: 200 len: 1736 microversion: 2.1 time: 0.201393 Jul 21 10:50:12.139074 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 252/482] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:11 2022] GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb => generated 1736 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:50:12.411681 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-cd03ba5e-cbe6-4fba-bb3c-0a964573040d tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:12.412348 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-cd03ba5e-cbe6-4fba-bb3c-0a964573040d tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:12.420304 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-cd03ba5e-cbe6-4fba-bb3c-0a964573040d tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:12.420751 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-cd03ba5e-cbe6-4fba-bb3c-0a964573040d tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:12.421517 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-cd03ba5e-cbe6-4fba-bb3c-0a964573040d tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:12.421949 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-cd03ba5e-cbe6-4fba-bb3c-0a964573040d tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:12.555392 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-cd03ba5e-cbe6-4fba-bb3c-0a964573040d tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:12.563731 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-cd03ba5e-cbe6-4fba-bb3c-0a964573040d tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:12.565256 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-cd03ba5e-cbe6-4fba-bb3c-0a964573040d tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:12.566410 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-cd03ba5e-cbe6-4fba-bb3c-0a964573040d tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1808 microversion: 2.20 time: 0.158833 Jul 21 10:50:12.567012 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 231/483] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:50:12 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:50:12.949730 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-316e1f6e-404e-4154-8829-9b821dbb7c1e tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:12.950412 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-316e1f6e-404e-4154-8829-9b821dbb7c1e tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] [instance: 6597f555-38e1-4d14-bf7c-6d8b5e5a26d4] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:12.951023 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-2321b408-588e-45d0-84e2-2af5126ef58c tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:12.951636 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-2321b408-588e-45d0-84e2-2af5126ef58c tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] [instance: eb24f843-eeb3-43dd-bd48-3bcf68e344cd] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:12.956549 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-316e1f6e-404e-4154-8829-9b821dbb7c1e tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:12.956999 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-316e1f6e-404e-4154-8829-9b821dbb7c1e tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:12.957445 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-2321b408-588e-45d0-84e2-2af5126ef58c tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:12.957756 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-316e1f6e-404e-4154-8829-9b821dbb7c1e tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:12.957893 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-2321b408-588e-45d0-84e2-2af5126ef58c tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:12.958187 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-316e1f6e-404e-4154-8829-9b821dbb7c1e tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:12.958658 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-2321b408-588e-45d0-84e2-2af5126ef58c tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:12.959087 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-2321b408-588e-45d0-84e2-2af5126ef58c tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:13.167491 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-2321b408-588e-45d0-84e2-2af5126ef58c tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e3fd195fd14b009ba56950dc542cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620ea9c4eaa74dc5858cf93d9fcad9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:13.170970 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-316e1f6e-404e-4154-8829-9b821dbb7c1e tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0271efe4b4e9592b29d9f124519b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eff05785bd84522ad637d8bed14563d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:13.173600 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell1:SELECT=100 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:50:13.175096 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-2321b408-588e-45d0-84e2-2af5126ef58c tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] 10.222.0.48 "GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd" status: 200 len: 1260 microversion: 2.1 time: 0.228122 Jul 21 10:50:13.175668 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 232/484] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:12 2022] GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd => generated 1260 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:50:13.180426 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-ce071f33-5f1f-4039-8875-9d8cc1df013b tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:13.181114 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-ce071f33-5f1f-4039-8875-9d8cc1df013b tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] [instance: dc183ff4-10bd-4827-a6a8-17f6b6d739be] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:13.181239 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-316e1f6e-404e-4154-8829-9b821dbb7c1e tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] 10.222.0.48 "GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4" status: 200 len: 1358 microversion: 2.1 time: 0.235270 Jul 21 10:50:13.181833 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 253/485] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:12 2022] GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4 => generated 1358 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:50:13.187678 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-7c8d0042-9cf6-4b6d-a869-63f39021f2a3 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:13.190449 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-7c8d0042-9cf6-4b6d-a869-63f39021f2a3 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: a54643be-3f53-4fe5-bab0-786b71d627bb] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:13.194429 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7c8d0042-9cf6-4b6d-a869-63f39021f2a3 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:13.194901 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7c8d0042-9cf6-4b6d-a869-63f39021f2a3 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:13.195656 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7c8d0042-9cf6-4b6d-a869-63f39021f2a3 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:13.196086 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7c8d0042-9cf6-4b6d-a869-63f39021f2a3 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:13.197099 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ce071f33-5f1f-4039-8875-9d8cc1df013b tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:13.197563 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ce071f33-5f1f-4039-8875-9d8cc1df013b tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:13.198364 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ce071f33-5f1f-4039-8875-9d8cc1df013b tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:13.198899 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ce071f33-5f1f-4039-8875-9d8cc1df013b tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:13.288560 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-ce071f33-5f1f-4039-8875-9d8cc1df013b tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ccc2d61c7045a8abba95e7cd002a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24d5a2477eb74d5da5911b37f9031110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:13.296203 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-ce071f33-5f1f-4039-8875-9d8cc1df013b tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] 10.222.0.48 "GET /compute/v2.1/servers/dc183ff4-10bd-4827-a6a8-17f6b6d739be" status: 200 len: 1472 microversion: 2.1 time: 0.119568 Jul 21 10:50:13.296781 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 233/486] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:13 2022] GET /compute/v2.1/servers/dc183ff4-10bd-4827-a6a8-17f6b6d739be => generated 1472 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:50:13.353013 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-7c8d0042-9cf6-4b6d-a869-63f39021f2a3 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:13.365370 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-7c8d0042-9cf6-4b6d-a869-63f39021f2a3 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb" status: 200 len: 1736 microversion: 2.1 time: 0.182361 Jul 21 10:50:13.366675 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 254/487] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:13 2022] GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb => generated 1736 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:50:13.585208 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-1a8776e3-bbcc-4ac4-abde-5753aa735af0 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:13.585773 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-1a8776e3-bbcc-4ac4-abde-5753aa735af0 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:13.593346 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1a8776e3-bbcc-4ac4-abde-5753aa735af0 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:13.593882 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1a8776e3-bbcc-4ac4-abde-5753aa735af0 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:13.594761 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1a8776e3-bbcc-4ac4-abde-5753aa735af0 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:13.595271 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1a8776e3-bbcc-4ac4-abde-5753aa735af0 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:13.739378 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-1a8776e3-bbcc-4ac4-abde-5753aa735af0 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:13.774845 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-1a8776e3-bbcc-4ac4-abde-5753aa735af0 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:13.776366 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-1a8776e3-bbcc-4ac4-abde-5753aa735af0 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:13.777529 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-1a8776e3-bbcc-4ac4-abde-5753aa735af0 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1808 microversion: 2.20 time: 0.196290 Jul 21 10:50:13.778381 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 234/488] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:50:13 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1808 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:50:14.194746 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-085dc71b-70ea-4e85-9c73-bcbcebd435df tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:14.195477 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-085dc71b-70ea-4e85-9c73-bcbcebd435df tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] [instance: eb24f843-eeb3-43dd-bd48-3bcf68e344cd] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:14.202934 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-085dc71b-70ea-4e85-9c73-bcbcebd435df tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:14.203315 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-085dc71b-70ea-4e85-9c73-bcbcebd435df tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:14.204128 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-085dc71b-70ea-4e85-9c73-bcbcebd435df tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:14.204570 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-085dc71b-70ea-4e85-9c73-bcbcebd435df tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:14.205157 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-652834bc-5d80-47e3-b704-21f1f80acda6 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:14.205795 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-652834bc-5d80-47e3-b704-21f1f80acda6 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] [instance: 6597f555-38e1-4d14-bf7c-6d8b5e5a26d4] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:14.212392 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-652834bc-5d80-47e3-b704-21f1f80acda6 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:14.212841 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-652834bc-5d80-47e3-b704-21f1f80acda6 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:14.213602 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-652834bc-5d80-47e3-b704-21f1f80acda6 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:14.214034 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-652834bc-5d80-47e3-b704-21f1f80acda6 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:14.436117 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-652834bc-5d80-47e3-b704-21f1f80acda6 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0271efe4b4e9592b29d9f124519b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eff05785bd84522ad637d8bed14563d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:14.439534 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-085dc71b-70ea-4e85-9c73-bcbcebd435df tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e3fd195fd14b009ba56950dc542cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620ea9c4eaa74dc5858cf93d9fcad9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:14.443750 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-652834bc-5d80-47e3-b704-21f1f80acda6 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] 10.222.0.48 "GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4" status: 200 len: 1358 microversion: 2.1 time: 0.242308 Jul 21 10:50:14.444320 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 235/489] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:14 2022] GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4 => generated 1358 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:50:14.448779 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-045a27a2-13ec-4965-8615-c5ada37ed7fc tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:14.452858 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-045a27a2-13ec-4965-8615-c5ada37ed7fc tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] [instance: dc183ff4-10bd-4827-a6a8-17f6b6d739be] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:14.459027 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-085dc71b-70ea-4e85-9c73-bcbcebd435df tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] 10.222.0.48 "GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd" status: 200 len: 1260 microversion: 2.1 time: 0.268233 Jul 21 10:50:14.459554 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 255/490] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:14 2022] GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd => generated 1260 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:50:14.460766 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-045a27a2-13ec-4965-8615-c5ada37ed7fc tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:14.461228 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-045a27a2-13ec-4965-8615-c5ada37ed7fc tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:14.462006 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-045a27a2-13ec-4965-8615-c5ada37ed7fc tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:14.462470 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-045a27a2-13ec-4965-8615-c5ada37ed7fc tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:14.464284 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-ea508c8b-0beb-4141-8d12-8b172d491f91 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:14.465033 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-ea508c8b-0beb-4141-8d12-8b172d491f91 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: a54643be-3f53-4fe5-bab0-786b71d627bb] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:14.472476 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ea508c8b-0beb-4141-8d12-8b172d491f91 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:14.472926 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ea508c8b-0beb-4141-8d12-8b172d491f91 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:14.473688 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ea508c8b-0beb-4141-8d12-8b172d491f91 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:14.474117 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ea508c8b-0beb-4141-8d12-8b172d491f91 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:14.535096 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-045a27a2-13ec-4965-8615-c5ada37ed7fc tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ccc2d61c7045a8abba95e7cd002a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24d5a2477eb74d5da5911b37f9031110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:14.546102 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-045a27a2-13ec-4965-8615-c5ada37ed7fc tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] 10.222.0.48 "GET /compute/v2.1/servers/dc183ff4-10bd-4827-a6a8-17f6b6d739be" status: 200 len: 1472 microversion: 2.1 time: 0.100803 Jul 21 10:50:14.546713 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 236/491] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:14 2022] GET /compute/v2.1/servers/dc183ff4-10bd-4827-a6a8-17f6b6d739be => generated 1472 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:50:14.619085 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-ea508c8b-0beb-4141-8d12-8b172d491f91 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:14.627531 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-ea508c8b-0beb-4141-8d12-8b172d491f91 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb" status: 200 len: 1736 microversion: 2.1 time: 0.166903 Jul 21 10:50:14.628394 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 256/492] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:14 2022] GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb => generated 1736 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:50:14.795872 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-4e88955b-b916-4559-843b-09ea6bbaf2e3 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:14.796472 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-4e88955b-b916-4559-843b-09ea6bbaf2e3 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:14.802919 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4e88955b-b916-4559-843b-09ea6bbaf2e3 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:14.803562 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4e88955b-b916-4559-843b-09ea6bbaf2e3 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:14.804312 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4e88955b-b916-4559-843b-09ea6bbaf2e3 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:14.804868 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4e88955b-b916-4559-843b-09ea6bbaf2e3 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:14.820008 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell1:SELECT=100 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:50:14.948336 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-4e88955b-b916-4559-843b-09ea6bbaf2e3 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:14.957592 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-4e88955b-b916-4559-843b-09ea6bbaf2e3 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:14.959197 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-4e88955b-b916-4559-843b-09ea6bbaf2e3 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:14.960328 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-4e88955b-b916-4559-843b-09ea6bbaf2e3 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1808 microversion: 2.20 time: 0.169100 Jul 21 10:50:14.960878 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 237/493] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:50:14 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:50:15.460397 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-543ea93b-79a3-40ff-8c40-4e90936b496c tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:15.461014 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-543ea93b-79a3-40ff-8c40-4e90936b496c tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] [instance: 6597f555-38e1-4d14-bf7c-6d8b5e5a26d4] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:15.462927 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:50:15.467994 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-543ea93b-79a3-40ff-8c40-4e90936b496c tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:15.468440 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-543ea93b-79a3-40ff-8c40-4e90936b496c tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:15.469201 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-543ea93b-79a3-40ff-8c40-4e90936b496c tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:15.469637 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-543ea93b-79a3-40ff-8c40-4e90936b496c tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:15.476465 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-10d669de-f32f-472b-9a76-2ebba79fa84c tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:15.477068 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-10d669de-f32f-472b-9a76-2ebba79fa84c tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] [instance: eb24f843-eeb3-43dd-bd48-3bcf68e344cd] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:15.484162 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-10d669de-f32f-472b-9a76-2ebba79fa84c tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:15.484606 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-10d669de-f32f-472b-9a76-2ebba79fa84c tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:15.485361 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-10d669de-f32f-472b-9a76-2ebba79fa84c tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:15.485785 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-10d669de-f32f-472b-9a76-2ebba79fa84c tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:15.668051 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-543ea93b-79a3-40ff-8c40-4e90936b496c tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0271efe4b4e9592b29d9f124519b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eff05785bd84522ad637d8bed14563d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:15.672745 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-10d669de-f32f-472b-9a76-2ebba79fa84c tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e3fd195fd14b009ba56950dc542cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620ea9c4eaa74dc5858cf93d9fcad9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:15.676430 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-543ea93b-79a3-40ff-8c40-4e90936b496c tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] 10.222.0.48 "GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4" status: 200 len: 1358 microversion: 2.1 time: 0.219802 Jul 21 10:50:15.676999 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 257/494] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:15 2022] GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4 => generated 1358 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:50:15.680064 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-10d669de-f32f-472b-9a76-2ebba79fa84c tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] 10.222.0.48 "GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd" status: 200 len: 1260 microversion: 2.1 time: 0.207417 Jul 21 10:50:15.689245 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 238/495] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:15 2022] GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd => generated 1260 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:50:15.689446 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-6f9d9921-1976-45ef-ab83-348383d923ec tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:15.689446 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-6f9d9921-1976-45ef-ab83-348383d923ec tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] [instance: dc183ff4-10bd-4827-a6a8-17f6b6d739be] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:15.689654 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-501d05b0-7437-4f8b-bb85-96f3252e58b6 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:15.689654 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-501d05b0-7437-4f8b-bb85-96f3252e58b6 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: a54643be-3f53-4fe5-bab0-786b71d627bb] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:15.689834 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6f9d9921-1976-45ef-ab83-348383d923ec tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:15.690200 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6f9d9921-1976-45ef-ab83-348383d923ec tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:15.691484 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6f9d9921-1976-45ef-ab83-348383d923ec tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:15.691776 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-501d05b0-7437-4f8b-bb85-96f3252e58b6 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:15.692266 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-501d05b0-7437-4f8b-bb85-96f3252e58b6 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:15.692385 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6f9d9921-1976-45ef-ab83-348383d923ec tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:15.693017 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-501d05b0-7437-4f8b-bb85-96f3252e58b6 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:15.693442 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-501d05b0-7437-4f8b-bb85-96f3252e58b6 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:15.766967 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-6f9d9921-1976-45ef-ab83-348383d923ec tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ccc2d61c7045a8abba95e7cd002a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24d5a2477eb74d5da5911b37f9031110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:15.774383 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-6f9d9921-1976-45ef-ab83-348383d923ec tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] 10.222.0.48 "GET /compute/v2.1/servers/dc183ff4-10bd-4827-a6a8-17f6b6d739be" status: 200 len: 1304 microversion: 2.1 time: 0.096429 Jul 21 10:50:15.774996 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 258/496] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:15 2022] GET /compute/v2.1/servers/dc183ff4-10bd-4827-a6a8-17f6b6d739be => generated 1304 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:50:15.852032 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-501d05b0-7437-4f8b-bb85-96f3252e58b6 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:15.860559 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-501d05b0-7437-4f8b-bb85-96f3252e58b6 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb" status: 200 len: 1736 microversion: 2.1 time: 0.179014 Jul 21 10:50:15.863767 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 239/497] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:15 2022] GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb => generated 1736 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:50:15.979655 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-d905514a-05f9-413d-a843-01143de77637 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:15.980303 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-d905514a-05f9-413d-a843-01143de77637 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:15.987045 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d905514a-05f9-413d-a843-01143de77637 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:15.987491 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d905514a-05f9-413d-a843-01143de77637 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:15.988257 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d905514a-05f9-413d-a843-01143de77637 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:15.988696 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d905514a-05f9-413d-a843-01143de77637 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:16.116029 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-d905514a-05f9-413d-a843-01143de77637 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:16.124367 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-d905514a-05f9-413d-a843-01143de77637 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:16.126035 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-d905514a-05f9-413d-a843-01143de77637 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:16.127316 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-d905514a-05f9-413d-a843-01143de77637 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1808 microversion: 2.20 time: 0.151669 Jul 21 10:50:16.127936 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 259/498] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:50:15 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:50:16.698247 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-297c0799-12c7-4e92-a99a-49480cfa654f tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:16.699092 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-297c0799-12c7-4e92-a99a-49480cfa654f tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] [instance: 6597f555-38e1-4d14-bf7c-6d8b5e5a26d4] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:16.711891 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-aa8e6ba1-9c71-460f-8077-6156c29206dd tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:16.715436 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-297c0799-12c7-4e92-a99a-49480cfa654f tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:16.715876 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-297c0799-12c7-4e92-a99a-49480cfa654f tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:16.716645 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-297c0799-12c7-4e92-a99a-49480cfa654f tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:16.717846 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-aa8e6ba1-9c71-460f-8077-6156c29206dd tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] [instance: eb24f843-eeb3-43dd-bd48-3bcf68e344cd] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:16.721075 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-297c0799-12c7-4e92-a99a-49480cfa654f tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:16.724739 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-aa8e6ba1-9c71-460f-8077-6156c29206dd tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:16.725332 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-aa8e6ba1-9c71-460f-8077-6156c29206dd tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:16.726222 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-aa8e6ba1-9c71-460f-8077-6156c29206dd tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:16.726782 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-aa8e6ba1-9c71-460f-8077-6156c29206dd tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:17.029070 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-297c0799-12c7-4e92-a99a-49480cfa654f tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0271efe4b4e9592b29d9f124519b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eff05785bd84522ad637d8bed14563d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:17.036826 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-297c0799-12c7-4e92-a99a-49480cfa654f tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] 10.222.0.48 "GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4" status: 200 len: 1358 microversion: 2.1 time: 0.347129 Jul 21 10:50:17.037416 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 240/499] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:16 2022] GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4 => generated 1358 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:50:17.046618 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-aa8e6ba1-9c71-460f-8077-6156c29206dd tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e3fd195fd14b009ba56950dc542cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620ea9c4eaa74dc5858cf93d9fcad9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:17.048724 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-aa8e6ba1-9c71-460f-8077-6156c29206dd tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] 10.222.0.48 "GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd" status: 200 len: 1260 microversion: 2.1 time: 0.343451 Jul 21 10:50:17.054436 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 260/500] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:16 2022] GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd => generated 1260 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:50:17.054436 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-d5d15c12-0db1-4ef6-92ea-d751846c7b2d tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:17.054994 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-d5d15c12-0db1-4ef6-92ea-d751846c7b2d tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: a54643be-3f53-4fe5-bab0-786b71d627bb] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:17.057805 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-dc860370-71f1-4dc6-8829-fa2915bcb927 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:17.058567 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-dc860370-71f1-4dc6-8829-fa2915bcb927 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] [instance: dc183ff4-10bd-4827-a6a8-17f6b6d739be] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:17.061896 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d5d15c12-0db1-4ef6-92ea-d751846c7b2d tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:17.062357 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d5d15c12-0db1-4ef6-92ea-d751846c7b2d tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:17.063215 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d5d15c12-0db1-4ef6-92ea-d751846c7b2d tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:17.063646 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d5d15c12-0db1-4ef6-92ea-d751846c7b2d tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:17.066016 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-dc860370-71f1-4dc6-8829-fa2915bcb927 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:17.066533 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-dc860370-71f1-4dc6-8829-fa2915bcb927 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:17.067398 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-dc860370-71f1-4dc6-8829-fa2915bcb927 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:17.067900 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-dc860370-71f1-4dc6-8829-fa2915bcb927 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:17.098304 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-dc860370-71f1-4dc6-8829-fa2915bcb927 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:17.098940 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-dc860370-71f1-4dc6-8829-fa2915bcb927 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:17.099463 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.objects.instance [None req-dc860370-71f1-4dc6-8829-fa2915bcb927 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lazy-loading 'fault' on Instance uuid dc183ff4-10bd-4827-a6a8-17f6b6d739be {{(pid=124868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 10:50:17.161165 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-dc860370-71f1-4dc6-8829-fa2915bcb927 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ccc2d61c7045a8abba95e7cd002a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24d5a2477eb74d5da5911b37f9031110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:17.169650 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-dc860370-71f1-4dc6-8829-fa2915bcb927 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] 10.222.0.48 "GET /compute/v2.1/servers/dc183ff4-10bd-4827-a6a8-17f6b6d739be" status: 200 len: 1309 microversion: 2.1 time: 0.121701 Jul 21 10:50:17.170890 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 241/501] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:17 2022] GET /compute/v2.1/servers/dc183ff4-10bd-4827-a6a8-17f6b6d739be => generated 1309 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:50:17.175755 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-7c31ca21-b0e8-484c-a7b7-fd3e1a466c24 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:17.176361 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-7c31ca21-b0e8-484c-a7b7-fd3e1a466c24 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:17.183327 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7c31ca21-b0e8-484c-a7b7-fd3e1a466c24 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:17.183777 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7c31ca21-b0e8-484c-a7b7-fd3e1a466c24 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:17.184549 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7c31ca21-b0e8-484c-a7b7-fd3e1a466c24 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:17.185019 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7c31ca21-b0e8-484c-a7b7-fd3e1a466c24 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:17.303284 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-d5d15c12-0db1-4ef6-92ea-d751846c7b2d tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:17.313825 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-d5d15c12-0db1-4ef6-92ea-d751846c7b2d tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb" status: 200 len: 1736 microversion: 2.1 time: 0.263166 Jul 21 10:50:17.315295 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 261/502] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:17 2022] GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb => generated 1736 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:50:17.441905 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-7c31ca21-b0e8-484c-a7b7-fd3e1a466c24 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:17.453562 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-7c31ca21-b0e8-484c-a7b7-fd3e1a466c24 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:17.455431 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-7c31ca21-b0e8-484c-a7b7-fd3e1a466c24 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:17.457190 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-7c31ca21-b0e8-484c-a7b7-fd3e1a466c24 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1808 microversion: 2.20 time: 0.284823 Jul 21 10:50:17.458282 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 242/503] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:50:17 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1808 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:50:18.054004 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-1c8fa66f-6433-498e-9820-adb1daaff483 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:18.054658 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-1c8fa66f-6433-498e-9820-adb1daaff483 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] [instance: 6597f555-38e1-4d14-bf7c-6d8b5e5a26d4] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:18.061624 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1c8fa66f-6433-498e-9820-adb1daaff483 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:18.062155 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1c8fa66f-6433-498e-9820-adb1daaff483 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:18.062946 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1c8fa66f-6433-498e-9820-adb1daaff483 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:18.063376 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1c8fa66f-6433-498e-9820-adb1daaff483 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:18.066265 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-80188935-0fcc-4809-b7fc-b526ee584081 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:18.066926 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-80188935-0fcc-4809-b7fc-b526ee584081 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] [instance: eb24f843-eeb3-43dd-bd48-3bcf68e344cd] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:18.073323 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-80188935-0fcc-4809-b7fc-b526ee584081 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:18.073770 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-80188935-0fcc-4809-b7fc-b526ee584081 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:18.074528 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-80188935-0fcc-4809-b7fc-b526ee584081 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:18.074982 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-80188935-0fcc-4809-b7fc-b526ee584081 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:18.270759 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-1c8fa66f-6433-498e-9820-adb1daaff483 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0271efe4b4e9592b29d9f124519b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eff05785bd84522ad637d8bed14563d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:18.275222 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-80188935-0fcc-4809-b7fc-b526ee584081 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e3fd195fd14b009ba56950dc542cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620ea9c4eaa74dc5858cf93d9fcad9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:18.278087 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-1c8fa66f-6433-498e-9820-adb1daaff483 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] 10.222.0.48 "GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4" status: 200 len: 1358 microversion: 2.1 time: 0.227857 Jul 21 10:50:18.278685 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 262/504] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:18 2022] GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4 => generated 1358 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:50:18.283168 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-80188935-0fcc-4809-b7fc-b526ee584081 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] 10.222.0.48 "GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd" status: 200 len: 1260 microversion: 2.1 time: 0.220832 Jul 21 10:50:18.283602 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-2fc9798e-32ef-4cd5-9bfe-38e2f6b9354a tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:18.283719 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 243/505] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:18 2022] GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd => generated 1260 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:50:18.284205 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-2fc9798e-32ef-4cd5-9bfe-38e2f6b9354a tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] [instance: dc183ff4-10bd-4827-a6a8-17f6b6d739be] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:18.290057 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2fc9798e-32ef-4cd5-9bfe-38e2f6b9354a tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:18.290501 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2fc9798e-32ef-4cd5-9bfe-38e2f6b9354a tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:18.291285 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2fc9798e-32ef-4cd5-9bfe-38e2f6b9354a tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:18.291727 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2fc9798e-32ef-4cd5-9bfe-38e2f6b9354a tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:18.305004 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.wsgi [None req-2fc9798e-32ef-4cd5-9bfe-38e2f6b9354a tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] HTTP exception thrown: Instance dc183ff4-10bd-4827-a6a8-17f6b6d739be could not be found. Jul 21 10:50:18.306669 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-2fc9798e-32ef-4cd5-9bfe-38e2f6b9354a tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Request method failure captured: Jul 21 10:50:18.306669 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: request: GET /compute/v2.1/servers/dc183ff4-10bd-4827-a6a8-17f6b6d739be HTTP/1.1 Jul 21 10:50:18.306669 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Accept: application/json Jul 21 10:50:18.306669 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Accept-Encoding: identity Jul 21 10:50:18.306669 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Connection: close Jul 21 10:50:18.306669 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Content-Length: 0 Jul 21 10:50:18.306669 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Content-Type: application/json Jul 21 10:50:18.306669 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Host: 10.222.0.48 Jul 21 10:50:18.306669 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Openstack-System-Scope: None Jul 21 10:50:18.306669 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: User-Agent: python-urllib3/1.26.9 Jul 21 10:50:18.306669 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Auth-Token: gAAAAABi2S7713n_e268krRyt-l_6ueqSfTi79OB537IIhyBzbeaJhdaFQ0biQzKIH7_TfqoLC4TOY8aCBn2jlVOSuzqLI_MHQrxGAC1u8OCRycxFd6rsClvn8CfaPHKpJzhPRFQ3Ojx7JGub20QrBxaeUFZuGNq7FgxAi7CjWh6hbhJJ6scAaI Jul 21 10:50:18.306669 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Domain-Id: None Jul 21 10:50:18.306669 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Domain-Name: None Jul 21 10:50:18.306669 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Identity-Status: Confirmed Jul 21 10:50:18.306669 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Is-Admin-Project: True Jul 21 10:50:18.306669 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Project-Domain-Id: default Jul 21 10:50:18.306669 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Project-Domain-Name: Default Jul 21 10:50:18.306669 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Project-Id: 24d5a2477eb74d5da5911b37f9031110 Jul 21 10:50:18.306669 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1148368882 Jul 21 10:50:18.306669 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Role: reader,member Jul 21 10:50:18.306669 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Roles: reader,member Jul 21 10:50:18.308175 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/24d5a2477eb74d5da5911b37f9031110"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/24d5a2477eb74d5da5911b37f9031110"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/24d5a2477eb74d5da5911b37f9031110"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_24d5a2477eb74d5da5911b37f9031110"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] Jul 21 10:50:18.308175 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Tenant: tempest-VolumesSnapshotTestJSON-1148368882 Jul 21 10:50:18.308175 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Tenant-Id: 24d5a2477eb74d5da5911b37f9031110 Jul 21 10:50:18.308175 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1148368882 Jul 21 10:50:18.308175 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User: tempest-VolumesSnapshotTestJSON-1148368882-project Jul 21 10:50:18.308175 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User-Domain-Id: default Jul 21 10:50:18.308175 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User-Domain-Name: Default Jul 21 10:50:18.308175 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User-Id: 26ccc2d61c7045a8abba95e7cd002a0a Jul 21 10:50:18.308175 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User-Name: tempest-VolumesSnapshotTestJSON-1148368882-project Jul 21 10:50:18.308175 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: method: > Jul 21 10:50:18.308175 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: exception: Instance dc183ff4-10bd-4827-a6a8-17f6b6d739be could not be found. Jul 21 10:50:18.308175 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: action_args: {'id': 'dc183ff4-10bd-4827-a6a8-17f6b6d739be'} Jul 21 10:50:18.309038 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 10:50:18.309038 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:50:18.309038 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 10:50:18.309038 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 10:50:18.309038 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 10:50:18.309038 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 10:50:18.309038 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 10:50:18.309038 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 10:50:18.309038 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 10:50:18.309038 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 10:50:18.309038 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc183ff4-10bd-4827-a6a8-17f6b6d739be could not be found. Jul 21 10:50:18.309038 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:50:18.309038 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:50:18.309038 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:50:18.309038 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:50:18.309038 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:50:18.309038 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:50:18.309038 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 10:50:18.309038 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 10:50:18.309038 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 10:50:18.311165 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 10:50:18.311165 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 10:50:18.311165 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 10:50:18.311165 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 10:50:18.311165 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 10:50:18.311165 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 10:50:18.311165 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 10:50:18.311165 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc183ff4-10bd-4827-a6a8-17f6b6d739be could not be found. Jul 21 10:50:18.311165 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:50:18.311165 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:50:18.311165 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:50:18.311165 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:50:18.311165 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:50:18.311165 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:50:18.311165 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 10:50:18.311165 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 10:50:18.311165 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc183ff4-10bd-4827-a6a8-17f6b6d739be could not be found. Jul 21 10:50:18.311165 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:50:18.312548 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-2fc9798e-32ef-4cd5-9bfe-38e2f6b9354a tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Returning 404 to user: Instance dc183ff4-10bd-4827-a6a8-17f6b6d739be could not be found. {{(pid=124867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 10:50:18.312548 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-2fc9798e-32ef-4cd5-9bfe-38e2f6b9354a tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] 10.222.0.48 "GET /compute/v2.1/servers/dc183ff4-10bd-4827-a6a8-17f6b6d739be" status: 404 len: 111 microversion: 2.1 time: 0.028136 Jul 21 10:50:18.312548 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 263/506] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:18 2022] GET /compute/v2.1/servers/dc183ff4-10bd-4827-a6a8-17f6b6d739be => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 10:50:18.331957 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-4317131f-91ad-4cc9-842b-1ff010512bb2 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:18.333464 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-4317131f-91ad-4cc9-842b-1ff010512bb2 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: a54643be-3f53-4fe5-bab0-786b71d627bb] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:18.338899 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4317131f-91ad-4cc9-842b-1ff010512bb2 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:18.339475 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4317131f-91ad-4cc9-842b-1ff010512bb2 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:18.340253 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4317131f-91ad-4cc9-842b-1ff010512bb2 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:18.340525 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4317131f-91ad-4cc9-842b-1ff010512bb2 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:18.470567 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-4317131f-91ad-4cc9-842b-1ff010512bb2 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:18.478811 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-4317131f-91ad-4cc9-842b-1ff010512bb2 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb" status: 200 len: 1736 microversion: 2.1 time: 0.150565 Jul 21 10:50:18.479208 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-33c5497f-1b8c-4007-bb51-71980d02a8c2 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:18.479675 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 244/507] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:18 2022] GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:50:18.480113 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-33c5497f-1b8c-4007-bb51-71980d02a8c2 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:18.487408 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-33c5497f-1b8c-4007-bb51-71980d02a8c2 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:18.487938 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-33c5497f-1b8c-4007-bb51-71980d02a8c2 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:18.488812 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-33c5497f-1b8c-4007-bb51-71980d02a8c2 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:18.489312 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-33c5497f-1b8c-4007-bb51-71980d02a8c2 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:18.620994 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-33c5497f-1b8c-4007-bb51-71980d02a8c2 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:18.629353 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-33c5497f-1b8c-4007-bb51-71980d02a8c2 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:18.631034 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-33c5497f-1b8c-4007-bb51-71980d02a8c2 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:18.632049 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-33c5497f-1b8c-4007-bb51-71980d02a8c2 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1808 microversion: 2.20 time: 0.159581 Jul 21 10:50:18.632916 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 264/508] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:50:18 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 10:50:19.296288 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-c0d7c5da-956b-442e-a0b1-c35bc9c5221a tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:19.296899 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-c0d7c5da-956b-442e-a0b1-c35bc9c5221a tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] [instance: 6597f555-38e1-4d14-bf7c-6d8b5e5a26d4] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:19.301415 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-32455f55-5027-46b2-b5e0-44be4d03428f tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:19.302025 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-32455f55-5027-46b2-b5e0-44be4d03428f tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] [instance: eb24f843-eeb3-43dd-bd48-3bcf68e344cd] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:19.303835 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c0d7c5da-956b-442e-a0b1-c35bc9c5221a tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:19.304204 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c0d7c5da-956b-442e-a0b1-c35bc9c5221a tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:19.305000 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c0d7c5da-956b-442e-a0b1-c35bc9c5221a tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:19.305438 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c0d7c5da-956b-442e-a0b1-c35bc9c5221a tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:19.308029 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-32455f55-5027-46b2-b5e0-44be4d03428f tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:19.308657 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-32455f55-5027-46b2-b5e0-44be4d03428f tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:19.309415 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-32455f55-5027-46b2-b5e0-44be4d03428f tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:19.309843 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-32455f55-5027-46b2-b5e0-44be4d03428f tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:19.504433 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-c0d7c5da-956b-442e-a0b1-c35bc9c5221a tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0271efe4b4e9592b29d9f124519b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eff05785bd84522ad637d8bed14563d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:19.509930 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-32455f55-5027-46b2-b5e0-44be4d03428f tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e3fd195fd14b009ba56950dc542cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620ea9c4eaa74dc5858cf93d9fcad9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:19.518170 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-32455f55-5027-46b2-b5e0-44be4d03428f tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] 10.222.0.48 "GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd" status: 200 len: 1260 microversion: 2.1 time: 0.221673 Jul 21 10:50:19.518378 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-c0d7c5da-956b-442e-a0b1-c35bc9c5221a tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] 10.222.0.48 "GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4" status: 200 len: 1358 microversion: 2.1 time: 0.226867 Jul 21 10:50:19.518918 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 265/509] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:19 2022] GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd => generated 1260 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:50:19.525837 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 245/510] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:19 2022] GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4 => generated 1358 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:50:19.529763 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-bdbe5026-f4bd-49ae-8ee1-54d2145650ce tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:19.530801 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-bdbe5026-f4bd-49ae-8ee1-54d2145650ce tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: a54643be-3f53-4fe5-bab0-786b71d627bb] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:19.536563 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-bdbe5026-f4bd-49ae-8ee1-54d2145650ce tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:19.537005 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-bdbe5026-f4bd-49ae-8ee1-54d2145650ce tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:19.537752 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-bdbe5026-f4bd-49ae-8ee1-54d2145650ce tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:19.538180 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-bdbe5026-f4bd-49ae-8ee1-54d2145650ce tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:19.651965 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-87e835fe-7ac3-4c46-8a71-23f1dd9b60bf tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:19.652732 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-87e835fe-7ac3-4c46-8a71-23f1dd9b60bf tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:19.659814 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-87e835fe-7ac3-4c46-8a71-23f1dd9b60bf tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:19.660257 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-87e835fe-7ac3-4c46-8a71-23f1dd9b60bf tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:19.661022 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-87e835fe-7ac3-4c46-8a71-23f1dd9b60bf tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:19.661448 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-87e835fe-7ac3-4c46-8a71-23f1dd9b60bf tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:19.968938 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-bdbe5026-f4bd-49ae-8ee1-54d2145650ce tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:19.975216 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-87e835fe-7ac3-4c46-8a71-23f1dd9b60bf tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:19.976942 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-bdbe5026-f4bd-49ae-8ee1-54d2145650ce tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb" status: 200 len: 1736 microversion: 2.1 time: 0.456976 Jul 21 10:50:19.977516 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 266/511] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:19 2022] GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb => generated 1736 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:50:19.984058 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-87e835fe-7ac3-4c46-8a71-23f1dd9b60bf tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:19.985552 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-87e835fe-7ac3-4c46-8a71-23f1dd9b60bf tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:19.986712 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-87e835fe-7ac3-4c46-8a71-23f1dd9b60bf tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1808 microversion: 2.20 time: 0.338786 Jul 21 10:50:19.987258 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 246/512] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:50:19 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1808 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 10:50:20.535512 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-62a14609-3e7c-4d25-adc1-a7f03e9ced38 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:20.536038 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-c39480d8-2aa1-43b6-90e2-470acac130e9 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:20.536574 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-62a14609-3e7c-4d25-adc1-a7f03e9ced38 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] [instance: eb24f843-eeb3-43dd-bd48-3bcf68e344cd] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:20.536673 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-c39480d8-2aa1-43b6-90e2-470acac130e9 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] [instance: 6597f555-38e1-4d14-bf7c-6d8b5e5a26d4] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:20.542273 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-62a14609-3e7c-4d25-adc1-a7f03e9ced38 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:20.542651 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c39480d8-2aa1-43b6-90e2-470acac130e9 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:20.542832 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-62a14609-3e7c-4d25-adc1-a7f03e9ced38 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:20.543101 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c39480d8-2aa1-43b6-90e2-470acac130e9 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:20.543596 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-62a14609-3e7c-4d25-adc1-a7f03e9ced38 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:20.543853 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c39480d8-2aa1-43b6-90e2-470acac130e9 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:20.544024 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-62a14609-3e7c-4d25-adc1-a7f03e9ced38 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:20.544315 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c39480d8-2aa1-43b6-90e2-470acac130e9 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:20.746754 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-62a14609-3e7c-4d25-adc1-a7f03e9ced38 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e3fd195fd14b009ba56950dc542cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620ea9c4eaa74dc5858cf93d9fcad9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:20.750395 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-c39480d8-2aa1-43b6-90e2-470acac130e9 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0271efe4b4e9592b29d9f124519b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eff05785bd84522ad637d8bed14563d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:20.755080 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-62a14609-3e7c-4d25-adc1-a7f03e9ced38 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] 10.222.0.48 "GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd" status: 200 len: 1260 microversion: 2.1 time: 0.223418 Jul 21 10:50:20.755648 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 267/513] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:20 2022] GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd => generated 1260 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:50:20.757791 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-c39480d8-2aa1-43b6-90e2-470acac130e9 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] 10.222.0.48 "GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4" status: 200 len: 1358 microversion: 2.1 time: 0.226145 Jul 21 10:50:20.758338 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 247/514] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:20 2022] GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4 => generated 1358 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:50:20.994223 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-f52a12e2-8f8e-4db8-879f-0d8bd04d8b4e tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:20.994854 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-f52a12e2-8f8e-4db8-879f-0d8bd04d8b4e tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: a54643be-3f53-4fe5-bab0-786b71d627bb] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:21.001229 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f52a12e2-8f8e-4db8-879f-0d8bd04d8b4e tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:21.001683 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f52a12e2-8f8e-4db8-879f-0d8bd04d8b4e tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:21.002456 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f52a12e2-8f8e-4db8-879f-0d8bd04d8b4e tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:21.002924 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f52a12e2-8f8e-4db8-879f-0d8bd04d8b4e tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:21.004674 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-a425cfac-6241-45b1-8e10-4cc00247d313 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:21.005278 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-a425cfac-6241-45b1-8e10-4cc00247d313 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:21.011305 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a425cfac-6241-45b1-8e10-4cc00247d313 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:21.011748 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a425cfac-6241-45b1-8e10-4cc00247d313 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:21.012559 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a425cfac-6241-45b1-8e10-4cc00247d313 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:21.012986 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a425cfac-6241-45b1-8e10-4cc00247d313 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:21.197368 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-f52a12e2-8f8e-4db8-879f-0d8bd04d8b4e tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:21.200572 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-a425cfac-6241-45b1-8e10-4cc00247d313 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:21.206130 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-f52a12e2-8f8e-4db8-879f-0d8bd04d8b4e tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb" status: 200 len: 1736 microversion: 2.1 time: 0.215751 Jul 21 10:50:21.206817 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 268/515] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:20 2022] GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb => generated 1736 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:50:21.210570 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-a425cfac-6241-45b1-8e10-4cc00247d313 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:21.212086 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-a425cfac-6241-45b1-8e10-4cc00247d313 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:21.213227 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-a425cfac-6241-45b1-8e10-4cc00247d313 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1808 microversion: 2.20 time: 0.212395 Jul 21 10:50:21.213777 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 248/516] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:50:20 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1808 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 10:50:21.771759 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-a3a03ed2-91e0-4715-9e77-43ee47ef3532 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:21.772404 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-a3a03ed2-91e0-4715-9e77-43ee47ef3532 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] [instance: eb24f843-eeb3-43dd-bd48-3bcf68e344cd] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:21.774563 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-b9087c7c-10d3-4ff1-b666-0ce249a8354e tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:21.775013 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-b9087c7c-10d3-4ff1-b666-0ce249a8354e tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] [instance: 6597f555-38e1-4d14-bf7c-6d8b5e5a26d4] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:21.779598 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a3a03ed2-91e0-4715-9e77-43ee47ef3532 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:21.781844 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a3a03ed2-91e0-4715-9e77-43ee47ef3532 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:21.781844 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a3a03ed2-91e0-4715-9e77-43ee47ef3532 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:21.781844 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a3a03ed2-91e0-4715-9e77-43ee47ef3532 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:21.782100 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b9087c7c-10d3-4ff1-b666-0ce249a8354e tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:21.782334 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b9087c7c-10d3-4ff1-b666-0ce249a8354e tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:21.783101 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b9087c7c-10d3-4ff1-b666-0ce249a8354e tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:21.783530 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b9087c7c-10d3-4ff1-b666-0ce249a8354e tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:21.995046 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-b9087c7c-10d3-4ff1-b666-0ce249a8354e tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0271efe4b4e9592b29d9f124519b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eff05785bd84522ad637d8bed14563d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:21.999088 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-a3a03ed2-91e0-4715-9e77-43ee47ef3532 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e3fd195fd14b009ba56950dc542cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620ea9c4eaa74dc5858cf93d9fcad9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:22.003467 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-b9087c7c-10d3-4ff1-b666-0ce249a8354e tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] 10.222.0.48 "GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4" status: 200 len: 1358 microversion: 2.1 time: 0.233007 Jul 21 10:50:22.004075 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 249/517] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:21 2022] GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4 => generated 1358 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:50:22.006646 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-a3a03ed2-91e0-4715-9e77-43ee47ef3532 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] 10.222.0.48 "GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd" status: 200 len: 1260 microversion: 2.1 time: 0.238985 Jul 21 10:50:22.011365 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 269/518] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:21 2022] GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd => generated 1260 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:50:22.224203 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-c06da8c7-72cc-4163-8f61-8168edf028ba tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:22.224832 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-c06da8c7-72cc-4163-8f61-8168edf028ba tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: a54643be-3f53-4fe5-bab0-786b71d627bb] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:22.230882 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c06da8c7-72cc-4163-8f61-8168edf028ba tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:22.231246 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-2f049419-35ae-4131-af84-854768c11a90 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:22.231368 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c06da8c7-72cc-4163-8f61-8168edf028ba tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:22.231854 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-2f049419-35ae-4131-af84-854768c11a90 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:22.232055 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c06da8c7-72cc-4163-8f61-8168edf028ba tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:22.233023 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c06da8c7-72cc-4163-8f61-8168edf028ba tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:22.237945 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2f049419-35ae-4131-af84-854768c11a90 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:22.238393 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2f049419-35ae-4131-af84-854768c11a90 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:22.239182 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2f049419-35ae-4131-af84-854768c11a90 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:22.239617 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2f049419-35ae-4131-af84-854768c11a90 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:22.437059 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-c06da8c7-72cc-4163-8f61-8168edf028ba tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:22.440630 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-2f049419-35ae-4131-af84-854768c11a90 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:22.445489 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-c06da8c7-72cc-4163-8f61-8168edf028ba tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb" status: 200 len: 1736 microversion: 2.1 time: 0.225011 Jul 21 10:50:22.446367 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 250/519] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:22 2022] GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb => generated 1736 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:50:22.450346 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-2f049419-35ae-4131-af84-854768c11a90 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:22.452817 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-2f049419-35ae-4131-af84-854768c11a90 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:22.454039 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-2f049419-35ae-4131-af84-854768c11a90 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1808 microversion: 2.20 time: 0.226722 Jul 21 10:50:22.454670 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 270/520] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:50:22 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1808 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 10:50:22.461685 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-ac5864cc-a1d4-4edc-9d05-25a96ea18583 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:22.462170 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-ac5864cc-a1d4-4edc-9d05-25a96ea18583 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:22.470075 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ac5864cc-a1d4-4edc-9d05-25a96ea18583 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:22.470521 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ac5864cc-a1d4-4edc-9d05-25a96ea18583 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:22.471303 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ac5864cc-a1d4-4edc-9d05-25a96ea18583 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:22.471732 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ac5864cc-a1d4-4edc-9d05-25a96ea18583 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:22.495513 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-ac5864cc-a1d4-4edc-9d05-25a96ea18583 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b/ips" status: 200 len: 150 microversion: 2.1 time: 0.037588 Jul 21 10:50:22.496068 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 251/521] 10.222.0.48 () {58 vars in 1247 bytes} [Thu Jul 21 10:50:22 2022] GET /compute/v2.1/servers/73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b/ips => generated 150 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:50:22.506658 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-79ddbfa4-1dd9-418d-9b7b-89f36ee0cd66 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5314c7de-a97a-4a8b-adc5-7761fd65219f"}} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:50:22.507787 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-79ddbfa4-1dd9-418d-9b7b-89f36ee0cd66 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:22.514923 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-79ddbfa4-1dd9-418d-9b7b-89f36ee0cd66 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:22.514923 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-79ddbfa4-1dd9-418d-9b7b-89f36ee0cd66 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:22.515680 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-79ddbfa4-1dd9-418d-9b7b-89f36ee0cd66 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:22.516115 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-79ddbfa4-1dd9-418d-9b7b-89f36ee0cd66 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:22.518413 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell1:SELECT=100 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:50:22.595382 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.wsgi [None req-79ddbfa4-1dd9-418d-9b7b-89f36ee0cd66 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] HTTP exception thrown: Invalid volume: volume 5314c7de-a97a-4a8b-adc5-7761fd65219f is already attached to instances: 691ae8fc-92e7-4940-99d8-7edb5a96d2f3 Jul 21 10:50:22.597231 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-79ddbfa4-1dd9-418d-9b7b-89f36ee0cd66 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Request method failure captured: Jul 21 10:50:22.597231 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: request: POST /compute/v2.1/servers/73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b/os-volume_attachments HTTP/1.1 Jul 21 10:50:22.597231 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Accept: application/json Jul 21 10:50:22.597231 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Accept-Encoding: identity Jul 21 10:50:22.597231 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Connection: close Jul 21 10:50:22.597231 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Content-Length: 74 Jul 21 10:50:22.597231 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Content-Type: application/json Jul 21 10:50:22.597231 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Host: 10.222.0.48 Jul 21 10:50:22.597231 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Openstack-System-Scope: None Jul 21 10:50:22.597231 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: User-Agent: python-urllib3/1.26.9 Jul 21 10:50:22.597231 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Auth-Token: gAAAAABi2S6IjD13fpvyB3gT_wfBhrxBWJW9IyP2Nfh-tKREma2qJlItcJifOI1FikOPoU86kC4jMPIUJv7c1XQEgHyn13RPV4dm8YXLpWP83NoB7MDue-0ef8jz1-9ETLoC72jgbX7x_bNoV_fia9kSfgVPDrqxya-pNvknwmV6TjdQwJPLki8 Jul 21 10:50:22.597231 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Domain-Id: None Jul 21 10:50:22.597231 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Domain-Name: None Jul 21 10:50:22.597231 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Identity-Status: Confirmed Jul 21 10:50:22.597231 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Is-Admin-Project: True Jul 21 10:50:22.597231 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Project-Domain-Id: default Jul 21 10:50:22.597231 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Project-Domain-Name: Default Jul 21 10:50:22.597231 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Project-Id: 0dc215aadb5345d791945658832aae4a Jul 21 10:50:22.597231 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Project-Name: tempest-AttachVolumeNegativeTest-692763952 Jul 21 10:50:22.597231 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Role: reader,member Jul 21 10:50:22.597231 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Roles: reader,member Jul 21 10:50:22.598784 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0dc215aadb5345d791945658832aae4a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0dc215aadb5345d791945658832aae4a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0dc215aadb5345d791945658832aae4a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0dc215aadb5345d791945658832aae4a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] Jul 21 10:50:22.598784 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Tenant: tempest-AttachVolumeNegativeTest-692763952 Jul 21 10:50:22.598784 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Tenant-Id: 0dc215aadb5345d791945658832aae4a Jul 21 10:50:22.598784 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-692763952 Jul 21 10:50:22.598784 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User: tempest-AttachVolumeNegativeTest-692763952-project Jul 21 10:50:22.598784 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User-Domain-Id: default Jul 21 10:50:22.598784 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User-Domain-Name: Default Jul 21 10:50:22.598784 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User-Id: 906e4bc4e9cc45ecb01cfca7918e461d Jul 21 10:50:22.598784 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User-Name: tempest-AttachVolumeNegativeTest-692763952-project Jul 21 10:50:22.598784 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Jul 21 10:50:22.598784 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: {"volumeAttachment": {"volumeId": "5314c7de-a97a-4a8b-adc5-7761fd65219f"}} Jul 21 10:50:22.598784 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: method: > Jul 21 10:50:22.599714 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: exception: Invalid volume: volume 5314c7de-a97a-4a8b-adc5-7761fd65219f is already attached to instances: 691ae8fc-92e7-4940-99d8-7edb5a96d2f3 Jul 21 10:50:22.599714 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: action_args: {'server_id': '73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b', 'body': {'volumeAttachment': {'volumeId': '5314c7de-a97a-4a8b-adc5-7761fd65219f'}}} Jul 21 10:50:22.599714 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 10:50:22.599714 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:50:22.599714 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 21 10:50:22.599714 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 21 10:50:22.599714 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 21 10:50:22.599714 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 21 10:50:22.599714 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 21 10:50:22.599714 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 21 10:50:22.599714 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 21 10:50:22.599714 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 21 10:50:22.599714 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 21 10:50:22.599714 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 21 10:50:22.599714 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 5314c7de-a97a-4a8b-adc5-7761fd65219f is already attached to instances: 691ae8fc-92e7-4940-99d8-7edb5a96d2f3 Jul 21 10:50:22.599714 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:50:22.599714 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:50:22.599714 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:50:22.599714 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:50:22.601134 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:50:22.601134 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:50:22.601134 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 10:50:22.601134 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 10:50:22.601134 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 10:50:22.601134 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 10:50:22.601134 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 21 10:50:22.601134 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 10:50:22.601134 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 21 10:50:22.601134 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 10:50:22.601134 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 21 10:50:22.601134 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 10:50:22.601134 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 21 10:50:22.601134 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 21 10:50:22.601134 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 5314c7de-a97a-4a8b-adc5-7761fd65219f is already attached to instances: 691ae8fc-92e7-4940-99d8-7edb5a96d2f3 Jul 21 10:50:22.601134 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:50:22.601134 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:50:22.601134 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:50:22.601134 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:50:22.601134 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:50:22.602671 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:50:22.602671 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 10:50:22.602671 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 10:50:22.602671 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 5314c7de-a97a-4a8b-adc5-7761fd65219f is already attached to instances: 691ae8fc-92e7-4940-99d8-7edb5a96d2f3 Jul 21 10:50:22.602671 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:50:22.602671 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-79ddbfa4-1dd9-418d-9b7b-89f36ee0cd66 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Returning 400 to user: Invalid volume: volume 5314c7de-a97a-4a8b-adc5-7761fd65219f is already attached to instances: 691ae8fc-92e7-4940-99d8-7edb5a96d2f3 {{(pid=124867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 10:50:22.602671 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-79ddbfa4-1dd9-418d-9b7b-89f36ee0cd66 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "POST /compute/v2.1/servers/73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.095998 Jul 21 10:50:22.602671 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 271/522] 10.222.0.48 () {60 vars in 1322 bytes} [Thu Jul 21 10:50:22 2022] POST /compute/v2.1/servers/73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b/os-volume_attachments => generated 174 bytes in 97 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 21 10:50:22.607506 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-c5af1208-a850-45bd-84fd-008c96a13144 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:22.608136 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-c5af1208-a850-45bd-84fd-008c96a13144 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:22.614043 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c5af1208-a850-45bd-84fd-008c96a13144 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:22.614491 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c5af1208-a850-45bd-84fd-008c96a13144 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:22.615275 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c5af1208-a850-45bd-84fd-008c96a13144 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:22.615741 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c5af1208-a850-45bd-84fd-008c96a13144 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:22.640012 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-c5af1208-a850-45bd-84fd-008c96a13144 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b] Going to try to terminate instance {{(pid=124868) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 10:50:22.770195 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:50:22.999161 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-c5af1208-a850-45bd-84fd-008c96a13144 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "DELETE /compute/v2.1/servers/73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b" status: 204 len: 0 microversion: 2.1 time: 0.394749 Jul 21 10:50:23.000887 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 252/523] 10.222.0.48 () {58 vars in 1238 bytes} [Thu Jul 21 10:50:22 2022] DELETE /compute/v2.1/servers/73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b => generated 0 bytes in 396 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 10:50:23.007902 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-2ce8ab4f-590f-4619-9510-98b522f782d5 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:23.008535 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-2ce8ab4f-590f-4619-9510-98b522f782d5 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:23.014999 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2ce8ab4f-590f-4619-9510-98b522f782d5 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:23.015383 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2ce8ab4f-590f-4619-9510-98b522f782d5 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:23.016161 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2ce8ab4f-590f-4619-9510-98b522f782d5 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:23.016591 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2ce8ab4f-590f-4619-9510-98b522f782d5 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:23.021093 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-099b73fe-3b35-4c43-8c0a-96d4476d93cd tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:23.021787 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-099b73fe-3b35-4c43-8c0a-96d4476d93cd tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] [instance: 6597f555-38e1-4d14-bf7c-6d8b5e5a26d4] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:23.027770 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-099b73fe-3b35-4c43-8c0a-96d4476d93cd tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:23.029976 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-099b73fe-3b35-4c43-8c0a-96d4476d93cd tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:23.029976 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-099b73fe-3b35-4c43-8c0a-96d4476d93cd tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:23.030900 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-099b73fe-3b35-4c43-8c0a-96d4476d93cd tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:23.206665 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-2ce8ab4f-590f-4619-9510-98b522f782d5 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906e4bc4e9cc45ecb01cfca7918e461d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc215aadb5345d791945658832aae4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:23.214037 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-2ce8ab4f-590f-4619-9510-98b522f782d5 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b" status: 200 len: 1681 microversion: 2.1 time: 0.210039 Jul 21 10:50:23.214620 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 272/524] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:23 2022] GET /compute/v2.1/servers/73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b => generated 1681 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:50:23.219926 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-cc8c847b-fa11-44ac-9e9c-de926bf9a780 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:23.220537 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-cc8c847b-fa11-44ac-9e9c-de926bf9a780 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] [instance: eb24f843-eeb3-43dd-bd48-3bcf68e344cd] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:23.226325 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-cc8c847b-fa11-44ac-9e9c-de926bf9a780 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:23.226809 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-cc8c847b-fa11-44ac-9e9c-de926bf9a780 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:23.227578 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-cc8c847b-fa11-44ac-9e9c-de926bf9a780 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:23.228012 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-cc8c847b-fa11-44ac-9e9c-de926bf9a780 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:23.231599 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-099b73fe-3b35-4c43-8c0a-96d4476d93cd tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0271efe4b4e9592b29d9f124519b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eff05785bd84522ad637d8bed14563d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:23.239962 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-099b73fe-3b35-4c43-8c0a-96d4476d93cd tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] 10.222.0.48 "GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4" status: 200 len: 1358 microversion: 2.1 time: 0.223223 Jul 21 10:50:23.240616 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 253/525] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:23 2022] GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4 => generated 1358 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:50:23.363407 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-cc8c847b-fa11-44ac-9e9c-de926bf9a780 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e3fd195fd14b009ba56950dc542cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620ea9c4eaa74dc5858cf93d9fcad9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:23.371040 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-cc8c847b-fa11-44ac-9e9c-de926bf9a780 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] 10.222.0.48 "GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd" status: 200 len: 1260 microversion: 2.1 time: 0.155407 Jul 21 10:50:23.371606 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 273/526] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:23 2022] GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:50:23.463388 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-9ca1032f-f6d8-4cb6-9845-6e4669fc1110 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:23.466078 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-9ca1032f-f6d8-4cb6-9845-6e4669fc1110 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: a54643be-3f53-4fe5-bab0-786b71d627bb] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:23.472530 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9ca1032f-f6d8-4cb6-9845-6e4669fc1110 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:23.472878 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9ca1032f-f6d8-4cb6-9845-6e4669fc1110 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:23.473710 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9ca1032f-f6d8-4cb6-9845-6e4669fc1110 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:23.474150 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9ca1032f-f6d8-4cb6-9845-6e4669fc1110 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:23.474360 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-22879423-f9d1-4b13-bf54-2240182e7bc8 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:23.475019 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-22879423-f9d1-4b13-bf54-2240182e7bc8 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:23.481375 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-22879423-f9d1-4b13-bf54-2240182e7bc8 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:23.481871 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-22879423-f9d1-4b13-bf54-2240182e7bc8 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:23.483066 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-22879423-f9d1-4b13-bf54-2240182e7bc8 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:23.483506 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-22879423-f9d1-4b13-bf54-2240182e7bc8 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:23.674795 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-9ca1032f-f6d8-4cb6-9845-6e4669fc1110 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:23.678432 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-22879423-f9d1-4b13-bf54-2240182e7bc8 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:23.690356 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-22879423-f9d1-4b13-bf54-2240182e7bc8 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:23.691499 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-9ca1032f-f6d8-4cb6-9845-6e4669fc1110 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb" status: 200 len: 1736 microversion: 2.1 time: 0.232105 Jul 21 10:50:23.692049 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-22879423-f9d1-4b13-bf54-2240182e7bc8 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:23.692779 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 254/527] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:23 2022] GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb => generated 1736 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:50:23.693206 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-22879423-f9d1-4b13-bf54-2240182e7bc8 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1808 microversion: 2.20 time: 0.222829 Jul 21 10:50:23.693984 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 274/528] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:50:23 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1808 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 10:50:24.233131 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-20e6eca3-9d85-4307-9144-69af55ee9e9e tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:24.233747 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-20e6eca3-9d85-4307-9144-69af55ee9e9e tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:24.240099 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-20e6eca3-9d85-4307-9144-69af55ee9e9e tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:24.240545 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-20e6eca3-9d85-4307-9144-69af55ee9e9e tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:24.241312 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-20e6eca3-9d85-4307-9144-69af55ee9e9e tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:24.241751 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-20e6eca3-9d85-4307-9144-69af55ee9e9e tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:24.256855 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-d3861ff2-2d82-4ee3-9769-0cc5d8ccba12 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:24.257944 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-d3861ff2-2d82-4ee3-9769-0cc5d8ccba12 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] [instance: 6597f555-38e1-4d14-bf7c-6d8b5e5a26d4] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:24.263533 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d3861ff2-2d82-4ee3-9769-0cc5d8ccba12 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:24.264295 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d3861ff2-2d82-4ee3-9769-0cc5d8ccba12 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:24.265243 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d3861ff2-2d82-4ee3-9769-0cc5d8ccba12 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:24.265659 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d3861ff2-2d82-4ee3-9769-0cc5d8ccba12 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:24.449734 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-20e6eca3-9d85-4307-9144-69af55ee9e9e tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906e4bc4e9cc45ecb01cfca7918e461d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc215aadb5345d791945658832aae4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:24.453432 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-d3861ff2-2d82-4ee3-9769-0cc5d8ccba12 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0271efe4b4e9592b29d9f124519b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eff05785bd84522ad637d8bed14563d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:24.459243 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-20e6eca3-9d85-4307-9144-69af55ee9e9e tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b" status: 200 len: 1681 microversion: 2.1 time: 0.230777 Jul 21 10:50:24.463316 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 255/529] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:24 2022] GET /compute/v2.1/servers/73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b => generated 1681 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:50:24.463451 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-d3861ff2-2d82-4ee3-9769-0cc5d8ccba12 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] 10.222.0.48 "GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4" status: 200 len: 1358 microversion: 2.1 time: 0.208887 Jul 21 10:50:24.463451 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 275/530] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:24 2022] GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4 => generated 1358 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:50:24.464520 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-bdfc5558-87f0-46e3-8b9c-393e05d5949b tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:24.465132 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-bdfc5558-87f0-46e3-8b9c-393e05d5949b tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] [instance: eb24f843-eeb3-43dd-bd48-3bcf68e344cd] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:24.471959 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-bdfc5558-87f0-46e3-8b9c-393e05d5949b tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:24.472414 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-bdfc5558-87f0-46e3-8b9c-393e05d5949b tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:24.473175 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-bdfc5558-87f0-46e3-8b9c-393e05d5949b tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:24.473607 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-bdfc5558-87f0-46e3-8b9c-393e05d5949b tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:24.615016 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-bdfc5558-87f0-46e3-8b9c-393e05d5949b tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e3fd195fd14b009ba56950dc542cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620ea9c4eaa74dc5858cf93d9fcad9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:24.622483 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-bdfc5558-87f0-46e3-8b9c-393e05d5949b tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] 10.222.0.48 "GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd" status: 200 len: 1260 microversion: 2.1 time: 0.161420 Jul 21 10:50:24.623103 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 256/531] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:24 2022] GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:50:24.710282 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-b3716752-c88f-48e9-86bc-4b508b7a376c tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:24.711002 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-b3716752-c88f-48e9-86bc-4b508b7a376c tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: a54643be-3f53-4fe5-bab0-786b71d627bb] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:24.712196 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-18c85cb4-4a62-41fc-888f-6723552f75f2 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:24.712806 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-18c85cb4-4a62-41fc-888f-6723552f75f2 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:24.718345 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b3716752-c88f-48e9-86bc-4b508b7a376c tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:24.718811 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b3716752-c88f-48e9-86bc-4b508b7a376c tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:24.719779 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b3716752-c88f-48e9-86bc-4b508b7a376c tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:24.720208 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b3716752-c88f-48e9-86bc-4b508b7a376c tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:24.720342 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-18c85cb4-4a62-41fc-888f-6723552f75f2 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:24.720761 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-18c85cb4-4a62-41fc-888f-6723552f75f2 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:24.721688 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-18c85cb4-4a62-41fc-888f-6723552f75f2 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:24.722130 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-18c85cb4-4a62-41fc-888f-6723552f75f2 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:24.918468 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-b3716752-c88f-48e9-86bc-4b508b7a376c tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:24.922461 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-18c85cb4-4a62-41fc-888f-6723552f75f2 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:24.927768 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-b3716752-c88f-48e9-86bc-4b508b7a376c tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb" status: 200 len: 1736 microversion: 2.1 time: 0.221340 Jul 21 10:50:24.928354 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 276/532] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:24 2022] GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb => generated 1736 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:50:24.931702 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-18c85cb4-4a62-41fc-888f-6723552f75f2 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:24.933337 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-18c85cb4-4a62-41fc-888f-6723552f75f2 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:24.934729 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-18c85cb4-4a62-41fc-888f-6723552f75f2 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1808 microversion: 2.20 time: 0.226761 Jul 21 10:50:24.945487 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 257/533] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:50:24 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1808 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:50:25.477439 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-947ecf8a-7b5b-44fe-bf64-9d8d1fa19c83 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:25.478304 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-947ecf8a-7b5b-44fe-bf64-9d8d1fa19c83 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:25.479242 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-6f85d343-54c8-413a-b47b-d3402369d61b tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:25.479843 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-6f85d343-54c8-413a-b47b-d3402369d61b tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] [instance: 6597f555-38e1-4d14-bf7c-6d8b5e5a26d4] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:25.484959 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-947ecf8a-7b5b-44fe-bf64-9d8d1fa19c83 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:25.485629 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-947ecf8a-7b5b-44fe-bf64-9d8d1fa19c83 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:25.486586 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-947ecf8a-7b5b-44fe-bf64-9d8d1fa19c83 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:25.487024 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-947ecf8a-7b5b-44fe-bf64-9d8d1fa19c83 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:25.487201 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6f85d343-54c8-413a-b47b-d3402369d61b tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:25.487842 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6f85d343-54c8-413a-b47b-d3402369d61b tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:25.488623 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6f85d343-54c8-413a-b47b-d3402369d61b tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:25.489053 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6f85d343-54c8-413a-b47b-d3402369d61b tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:25.576778 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-947ecf8a-7b5b-44fe-bf64-9d8d1fa19c83 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906e4bc4e9cc45ecb01cfca7918e461d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc215aadb5345d791945658832aae4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:25.584916 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-947ecf8a-7b5b-44fe-bf64-9d8d1fa19c83 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b" status: 200 len: 1613 microversion: 2.1 time: 0.111374 Jul 21 10:50:25.586952 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 277/534] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:25 2022] GET /compute/v2.1/servers/73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b => generated 1613 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:50:25.640134 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-b0703070-d7f1-4b31-b0e3-4f00178e2d43 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:25.642344 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-b0703070-d7f1-4b31-b0e3-4f00178e2d43 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] [instance: eb24f843-eeb3-43dd-bd48-3bcf68e344cd] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:25.650276 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b0703070-d7f1-4b31-b0e3-4f00178e2d43 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:25.650887 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b0703070-d7f1-4b31-b0e3-4f00178e2d43 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:25.651763 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b0703070-d7f1-4b31-b0e3-4f00178e2d43 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:25.652441 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b0703070-d7f1-4b31-b0e3-4f00178e2d43 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:25.665102 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-6f85d343-54c8-413a-b47b-d3402369d61b tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0271efe4b4e9592b29d9f124519b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eff05785bd84522ad637d8bed14563d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:25.673720 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-6f85d343-54c8-413a-b47b-d3402369d61b tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] 10.222.0.48 "GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4" status: 200 len: 1358 microversion: 2.1 time: 0.198152 Jul 21 10:50:25.674288 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 258/535] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:25 2022] GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4 => generated 1358 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:50:25.680073 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [req-ceb364fe-9b93-444d-b091-bb9305144a87 req-bee301ab-8b98-4940-8ff9-199a925c1d9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b", "name": "network-vif-deleted", "tag": "a13ed13b-8d67-46d9-a44b-a3230486e080"}]} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:50:25.685229 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:50:25.690930 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-ceb364fe-9b93-444d-b091-bb9305144a87 req-bee301ab-8b98-4940-8ff9-199a925c1d9f service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:25.691430 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-ceb364fe-9b93-444d-b091-bb9305144a87 req-bee301ab-8b98-4940-8ff9-199a925c1d9f service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:25.709017 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.compute.server_external_events [req-ceb364fe-9b93-444d-b091-bb9305144a87 req-bee301ab-8b98-4940-8ff9-199a925c1d9f service nova] Creating event network-vif-deleted:a13ed13b-8d67-46d9-a44b-a3230486e080 for instance 73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b on hv-cinder-84980 Jul 21 10:50:25.714517 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [req-ceb364fe-9b93-444d-b091-bb9305144a87 req-bee301ab-8b98-4940-8ff9-199a925c1d9f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038593 Jul 21 10:50:25.715723 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 259/536] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 21 10:50:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:50:25.801858 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-b0703070-d7f1-4b31-b0e3-4f00178e2d43 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e3fd195fd14b009ba56950dc542cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620ea9c4eaa74dc5858cf93d9fcad9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:25.809493 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-b0703070-d7f1-4b31-b0e3-4f00178e2d43 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] 10.222.0.48 "GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd" status: 200 len: 1260 microversion: 2.1 time: 0.175075 Jul 21 10:50:25.810055 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 278/537] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:25 2022] GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd => generated 1260 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:50:25.945508 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-ba4338a9-cf0e-4346-b1f5-c97d5f8f22d1 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:25.946287 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-ba4338a9-cf0e-4346-b1f5-c97d5f8f22d1 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: a54643be-3f53-4fe5-bab0-786b71d627bb] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:25.953960 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ba4338a9-cf0e-4346-b1f5-c97d5f8f22d1 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:25.954177 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-dc223592-cce9-421a-8358-aa0779864621 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:25.954402 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ba4338a9-cf0e-4346-b1f5-c97d5f8f22d1 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:25.955217 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ba4338a9-cf0e-4346-b1f5-c97d5f8f22d1 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:25.955651 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ba4338a9-cf0e-4346-b1f5-c97d5f8f22d1 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:25.955870 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-dc223592-cce9-421a-8358-aa0779864621 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:25.962593 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-dc223592-cce9-421a-8358-aa0779864621 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:25.963303 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-dc223592-cce9-421a-8358-aa0779864621 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:25.964261 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-dc223592-cce9-421a-8358-aa0779864621 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:25.965034 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-dc223592-cce9-421a-8358-aa0779864621 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:26.161531 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-ba4338a9-cf0e-4346-b1f5-c97d5f8f22d1 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:26.172231 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-ba4338a9-cf0e-4346-b1f5-c97d5f8f22d1 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb" status: 200 len: 1736 microversion: 2.1 time: 0.231267 Jul 21 10:50:26.173023 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 260/538] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:25 2022] GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb => generated 1736 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:50:26.175555 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-dc223592-cce9-421a-8358-aa0779864621 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:26.184115 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-dc223592-cce9-421a-8358-aa0779864621 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:26.186506 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-dc223592-cce9-421a-8358-aa0779864621 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:26.187067 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-dc223592-cce9-421a-8358-aa0779864621 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1808 microversion: 2.20 time: 0.238067 Jul 21 10:50:26.197894 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 279/539] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:50:25 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1808 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:50:26.603510 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-b849474d-8a58-4ba5-a9e7-29f40c715532 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:26.604151 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-b849474d-8a58-4ba5-a9e7-29f40c715532 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:26.614874 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b849474d-8a58-4ba5-a9e7-29f40c715532 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:26.615329 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b849474d-8a58-4ba5-a9e7-29f40c715532 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:26.616157 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b849474d-8a58-4ba5-a9e7-29f40c715532 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:26.617741 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b849474d-8a58-4ba5-a9e7-29f40c715532 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:26.691559 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-b849474d-8a58-4ba5-a9e7-29f40c715532 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906e4bc4e9cc45ecb01cfca7918e461d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc215aadb5345d791945658832aae4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:26.693938 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-bb4884c2-c0f4-4d64-aed1-49c49bac2a66 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:26.694692 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-bb4884c2-c0f4-4d64-aed1-49c49bac2a66 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] [instance: 6597f555-38e1-4d14-bf7c-6d8b5e5a26d4] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:26.700681 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-b849474d-8a58-4ba5-a9e7-29f40c715532 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b" status: 200 len: 1613 microversion: 2.1 time: 0.101088 Jul 21 10:50:26.701932 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-bb4884c2-c0f4-4d64-aed1-49c49bac2a66 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:26.702720 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-bb4884c2-c0f4-4d64-aed1-49c49bac2a66 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:26.703779 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-bb4884c2-c0f4-4d64-aed1-49c49bac2a66 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:26.704288 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-bb4884c2-c0f4-4d64-aed1-49c49bac2a66 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:26.711239 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 261/540] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:26 2022] GET /compute/v2.1/servers/73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b => generated 1613 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:50:26.830317 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-639361fc-a985-44b4-96fe-1d996d6d4076 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:26.831555 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-639361fc-a985-44b4-96fe-1d996d6d4076 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] [instance: eb24f843-eeb3-43dd-bd48-3bcf68e344cd] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:26.842652 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-639361fc-a985-44b4-96fe-1d996d6d4076 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:26.843366 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-639361fc-a985-44b4-96fe-1d996d6d4076 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:26.844534 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-639361fc-a985-44b4-96fe-1d996d6d4076 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:26.845533 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-639361fc-a985-44b4-96fe-1d996d6d4076 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:26.860342 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-bb4884c2-c0f4-4d64-aed1-49c49bac2a66 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0271efe4b4e9592b29d9f124519b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eff05785bd84522ad637d8bed14563d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:26.869127 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-bb4884c2-c0f4-4d64-aed1-49c49bac2a66 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] 10.222.0.48 "GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4" status: 200 len: 1358 microversion: 2.1 time: 0.181190 Jul 21 10:50:26.870369 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 280/541] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:26 2022] GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4 => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:50:27.000605 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-639361fc-a985-44b4-96fe-1d996d6d4076 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e3fd195fd14b009ba56950dc542cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620ea9c4eaa74dc5858cf93d9fcad9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:27.008816 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-639361fc-a985-44b4-96fe-1d996d6d4076 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] 10.222.0.48 "GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd" status: 200 len: 1260 microversion: 2.1 time: 0.185893 Jul 21 10:50:27.009722 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 262/542] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:26 2022] GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd => generated 1260 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:50:27.189745 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-f08f3b09-21f2-47d6-b926-7f3293864d32 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:27.190452 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-f08f3b09-21f2-47d6-b926-7f3293864d32 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: a54643be-3f53-4fe5-bab0-786b71d627bb] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:27.196874 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f08f3b09-21f2-47d6-b926-7f3293864d32 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:27.197350 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f08f3b09-21f2-47d6-b926-7f3293864d32 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:27.198106 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f08f3b09-21f2-47d6-b926-7f3293864d32 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:27.198534 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f08f3b09-21f2-47d6-b926-7f3293864d32 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:27.206034 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-7cf30791-bc14-44ff-be02-29be11872fe4 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:27.206706 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-7cf30791-bc14-44ff-be02-29be11872fe4 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:27.212682 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7cf30791-bc14-44ff-be02-29be11872fe4 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:27.213128 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7cf30791-bc14-44ff-be02-29be11872fe4 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:27.213876 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7cf30791-bc14-44ff-be02-29be11872fe4 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:27.214309 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7cf30791-bc14-44ff-be02-29be11872fe4 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:27.396868 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-f08f3b09-21f2-47d6-b926-7f3293864d32 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:27.405823 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-f08f3b09-21f2-47d6-b926-7f3293864d32 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb" status: 200 len: 1736 microversion: 2.1 time: 0.220551 Jul 21 10:50:27.406633 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 281/543] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:27 2022] GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb => generated 1736 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:50:27.411439 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-7cf30791-bc14-44ff-be02-29be11872fe4 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:27.421421 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-7cf30791-bc14-44ff-be02-29be11872fe4 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:27.423224 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-7cf30791-bc14-44ff-be02-29be11872fe4 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:27.424418 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-7cf30791-bc14-44ff-be02-29be11872fe4 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1808 microversion: 2.20 time: 0.222582 Jul 21 10:50:27.425019 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 263/544] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:50:27 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1808 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 10:50:27.726992 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-e7813697-70c7-43e5-bdd6-c4f3307f2c44 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:27.727564 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [req-524e03bf-e210-46d5-93a9-3ce26db70939 req-ff123a14-dbc2-4258-bd2b-d12f104f0c7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e730525-7ce4-4a5a-8023-84cae6b1da3d", "name": "network-vif-plugged", "status": "completed", "tag": "e0efd748-6569-4435-ab16-d9acccb72164"}]} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:50:27.727937 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-e7813697-70c7-43e5-bdd6-c4f3307f2c44 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:27.736575 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e7813697-70c7-43e5-bdd6-c4f3307f2c44 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:27.737159 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e7813697-70c7-43e5-bdd6-c4f3307f2c44 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:27.738040 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e7813697-70c7-43e5-bdd6-c4f3307f2c44 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:27.738595 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e7813697-70c7-43e5-bdd6-c4f3307f2c44 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:27.742841 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-524e03bf-e210-46d5-93a9-3ce26db70939 req-ff123a14-dbc2-4258-bd2b-d12f104f0c7b service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:27.743490 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-524e03bf-e210-46d5-93a9-3ce26db70939 req-ff123a14-dbc2-4258-bd2b-d12f104f0c7b service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:27.759173 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.compute.server_external_events [req-524e03bf-e210-46d5-93a9-3ce26db70939 req-ff123a14-dbc2-4258-bd2b-d12f104f0c7b service nova] Creating event network-vif-plugged:e0efd748-6569-4435-ab16-d9acccb72164 for instance 1e730525-7ce4-4a5a-8023-84cae6b1da3d on hv-cinder-84980 Jul 21 10:50:27.768697 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [req-524e03bf-e210-46d5-93a9-3ce26db70939 req-ff123a14-dbc2-4258-bd2b-d12f104f0c7b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055029 Jul 21 10:50:27.770089 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 282/545] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 21 10:50:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:50:27.775634 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e7813697-70c7-43e5-bdd6-c4f3307f2c44 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:27.776262 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e7813697-70c7-43e5-bdd6-c4f3307f2c44 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:27.776883 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.objects.instance [None req-e7813697-70c7-43e5-bdd6-c4f3307f2c44 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lazy-loading 'fault' on Instance uuid 73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b {{(pid=124868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 10:50:27.785113 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-498d65c6-1917-48ab-9f3b-ac6945a85ff7 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2036737060", "imageRef": "282ddb30-fa0f-489d-9cc3-a3e70e03c631", "flavorRef": "452", "networks": [{"uuid": "b613594b-0f24-4b36-a4b2-dcc23406f4ab"}]}} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:50:27.820096 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-e7813697-70c7-43e5-bdd6-c4f3307f2c44 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906e4bc4e9cc45ecb01cfca7918e461d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc215aadb5345d791945658832aae4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:27.831240 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-e7813697-70c7-43e5-bdd6-c4f3307f2c44 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b" status: 200 len: 1330 microversion: 2.1 time: 0.115868 Jul 21 10:50:27.845290 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 264/546] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:27 2022] GET /compute/v2.1/servers/73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b => generated 1330 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:50:27.845642 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.network.neutron [None req-498d65c6-1917-48ab-9f3b-ac6945a85ff7 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] validate_networks() for [('b613594b-0f24-4b36-a4b2-dcc23406f4ab', None, None, None, None, None)] {{(pid=124867) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 10:50:27.887959 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-7b54864b-dfe0-4182-a306-65500244142c tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:27.889724 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-7b54864b-dfe0-4182-a306-65500244142c tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] [instance: 6597f555-38e1-4d14-bf7c-6d8b5e5a26d4] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:27.895802 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7b54864b-dfe0-4182-a306-65500244142c tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:27.896245 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7b54864b-dfe0-4182-a306-65500244142c tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:27.896994 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7b54864b-dfe0-4182-a306-65500244142c tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:27.897603 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7b54864b-dfe0-4182-a306-65500244142c tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:28.108746 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-7b54864b-dfe0-4182-a306-65500244142c tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0271efe4b4e9592b29d9f124519b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eff05785bd84522ad637d8bed14563d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:28.119332 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-7b54864b-dfe0-4182-a306-65500244142c tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] 10.222.0.48 "GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4" status: 200 len: 1358 microversion: 2.1 time: 0.235607 Jul 21 10:50:28.131290 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 265/547] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:27 2022] GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4 => generated 1358 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:50:28.138116 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-20e52f1a-c3a9-4371-bbf9-db3cde9b4b14 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:28.139999 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-20e52f1a-c3a9-4371-bbf9-db3cde9b4b14 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] [instance: eb24f843-eeb3-43dd-bd48-3bcf68e344cd] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:28.146435 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-20e52f1a-c3a9-4371-bbf9-db3cde9b4b14 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:28.146912 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-20e52f1a-c3a9-4371-bbf9-db3cde9b4b14 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:28.147728 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-20e52f1a-c3a9-4371-bbf9-db3cde9b4b14 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:28.148155 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-20e52f1a-c3a9-4371-bbf9-db3cde9b4b14 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:28.391415 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-20e52f1a-c3a9-4371-bbf9-db3cde9b4b14 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e3fd195fd14b009ba56950dc542cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620ea9c4eaa74dc5858cf93d9fcad9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:28.407376 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-20e52f1a-c3a9-4371-bbf9-db3cde9b4b14 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] 10.222.0.48 "GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd" status: 200 len: 1260 microversion: 2.1 time: 0.274780 Jul 21 10:50:28.412013 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 266/548] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:28 2022] GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd => generated 1260 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:50:28.424814 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-d8fbea91-7e64-4bef-b65f-b1c50f9d6f1e tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:28.425716 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-d8fbea91-7e64-4bef-b65f-b1c50f9d6f1e tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: a54643be-3f53-4fe5-bab0-786b71d627bb] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:28.432747 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d8fbea91-7e64-4bef-b65f-b1c50f9d6f1e tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:28.434832 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d8fbea91-7e64-4bef-b65f-b1c50f9d6f1e tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:28.434832 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d8fbea91-7e64-4bef-b65f-b1c50f9d6f1e tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:28.436021 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d8fbea91-7e64-4bef-b65f-b1c50f9d6f1e tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:28.449285 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-498d65c6-1917-48ab-9f3b-ac6945a85ff7 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Flavor limits 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 10:50:28.449714 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-498d65c6-1917-48ab-9f3b-ac6945a85ff7 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Image limits 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 10:50:28.450186 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-498d65c6-1917-48ab-9f3b-ac6945a85ff7 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Flavor pref 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 10:50:28.450614 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-498d65c6-1917-48ab-9f3b-ac6945a85ff7 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Image pref 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 10:50:28.451831 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-498d65c6-1917-48ab-9f3b-ac6945a85ff7 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 10:50:28.473681 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-498d65c6-1917-48ab-9f3b-ac6945a85ff7 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:28.474470 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-498d65c6-1917-48ab-9f3b-ac6945a85ff7 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:28.475474 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-498d65c6-1917-48ab-9f3b-ac6945a85ff7 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:28.476064 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-498d65c6-1917-48ab-9f3b-ac6945a85ff7 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:28.512836 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.quota [None req-498d65c6-1917-48ab-9f3b-ac6945a85ff7 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Getting quotas for project 24d5a2477eb74d5da5911b37f9031110. Resources: {'ram', 'instances', 'cores'} {{(pid=124867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 10:50:28.530041 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.quota [None req-498d65c6-1917-48ab-9f3b-ac6945a85ff7 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Getting quotas for user 26ccc2d61c7045a8abba95e7cd002a0a and project 24d5a2477eb74d5da5911b37f9031110. Resources: {'ram', 'instances', 'cores'} {{(pid=124867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 10:50:28.550675 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-498d65c6-1917-48ab-9f3b-ac6945a85ff7 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Going to run 1 instances... {{(pid=124867) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 10:50:28.557508 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-498d65c6-1917-48ab-9f3b-ac6945a85ff7 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] [instance: 082cef74-9509-4b17-8250-cd6527a6e3eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='282ddb30-fa0f-489d-9cc3-a3e70e03c631',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124867) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 10:50:28.603924 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-d8fbea91-7e64-4bef-b65f-b1c50f9d6f1e tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:28.612742 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-d8fbea91-7e64-4bef-b65f-b1c50f9d6f1e tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb" status: 200 len: 1736 microversion: 2.1 time: 0.193426 Jul 21 10:50:28.613687 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 267/549] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:28 2022] GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb => generated 1736 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:50:28.618347 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-ca16184b-97e1-4bc2-b115-3c98b8fb71d1 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:28.619742 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-ca16184b-97e1-4bc2-b115-3c98b8fb71d1 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:28.625666 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ca16184b-97e1-4bc2-b115-3c98b8fb71d1 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:28.626115 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ca16184b-97e1-4bc2-b115-3c98b8fb71d1 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:28.626920 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ca16184b-97e1-4bc2-b115-3c98b8fb71d1 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:28.627354 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ca16184b-97e1-4bc2-b115-3c98b8fb71d1 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:28.737694 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-498d65c6-1917-48ab-9f3b-ac6945a85ff7 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.958460 Jul 21 10:50:28.743302 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 283/550] 10.222.0.48 () {60 vars in 1146 bytes} [Thu Jul 21 10:50:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 960 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 10:50:28.749383 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-a8d63233-1956-4e42-a619-9bd7994efae7 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:28.750046 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-a8d63233-1956-4e42-a619-9bd7994efae7 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] [instance: 082cef74-9509-4b17-8250-cd6527a6e3eb] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:28.775437 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-ca16184b-97e1-4bc2-b115-3c98b8fb71d1 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:28.789012 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-ca16184b-97e1-4bc2-b115-3c98b8fb71d1 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:28.791122 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-ca16184b-97e1-4bc2-b115-3c98b8fb71d1 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:28.792459 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-ca16184b-97e1-4bc2-b115-3c98b8fb71d1 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1808 microversion: 2.20 time: 0.177768 Jul 21 10:50:28.793414 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 268/551] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:50:28 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1808 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:50:28.818756 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-a8d63233-1956-4e42-a619-9bd7994efae7 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ccc2d61c7045a8abba95e7cd002a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24d5a2477eb74d5da5911b37f9031110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:28.828229 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-a8d63233-1956-4e42-a619-9bd7994efae7 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] 10.222.0.48 "GET /compute/v2.1/servers/082cef74-9509-4b17-8250-cd6527a6e3eb" status: 200 len: 1219 microversion: 2.1 time: 0.083490 Jul 21 10:50:28.829391 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 284/552] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:28 2022] GET /compute/v2.1/servers/082cef74-9509-4b17-8250-cd6527a6e3eb => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:50:28.853135 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-95c3aede-2806-404c-ab86-99227891ac88 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:28.853135 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-95c3aede-2806-404c-ab86-99227891ac88 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:28.859401 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-95c3aede-2806-404c-ab86-99227891ac88 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:28.859860 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-95c3aede-2806-404c-ab86-99227891ac88 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:28.860537 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-95c3aede-2806-404c-ab86-99227891ac88 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:28.860986 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-95c3aede-2806-404c-ab86-99227891ac88 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:28.875894 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.wsgi [None req-95c3aede-2806-404c-ab86-99227891ac88 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] HTTP exception thrown: Instance 73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b could not be found. Jul 21 10:50:28.880890 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-95c3aede-2806-404c-ab86-99227891ac88 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Request method failure captured: Jul 21 10:50:28.880890 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: request: GET /compute/v2.1/servers/73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b HTTP/1.1 Jul 21 10:50:28.880890 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Accept: application/json Jul 21 10:50:28.880890 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Accept-Encoding: identity Jul 21 10:50:28.880890 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Connection: close Jul 21 10:50:28.880890 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Content-Length: 0 Jul 21 10:50:28.880890 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Content-Type: application/json Jul 21 10:50:28.880890 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Host: 10.222.0.48 Jul 21 10:50:28.880890 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Openstack-System-Scope: None Jul 21 10:50:28.880890 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: User-Agent: python-urllib3/1.26.9 Jul 21 10:50:28.880890 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Auth-Token: gAAAAABi2S6IjD13fpvyB3gT_wfBhrxBWJW9IyP2Nfh-tKREma2qJlItcJifOI1FikOPoU86kC4jMPIUJv7c1XQEgHyn13RPV4dm8YXLpWP83NoB7MDue-0ef8jz1-9ETLoC72jgbX7x_bNoV_fia9kSfgVPDrqxya-pNvknwmV6TjdQwJPLki8 Jul 21 10:50:28.880890 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Domain-Id: None Jul 21 10:50:28.880890 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Domain-Name: None Jul 21 10:50:28.880890 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Identity-Status: Confirmed Jul 21 10:50:28.880890 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Is-Admin-Project: True Jul 21 10:50:28.880890 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Domain-Id: default Jul 21 10:50:28.880890 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Domain-Name: Default Jul 21 10:50:28.880890 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Id: 0dc215aadb5345d791945658832aae4a Jul 21 10:50:28.880890 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Name: tempest-AttachVolumeNegativeTest-692763952 Jul 21 10:50:28.880890 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Role: reader,member Jul 21 10:50:28.880890 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Roles: reader,member Jul 21 10:50:28.882672 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0dc215aadb5345d791945658832aae4a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0dc215aadb5345d791945658832aae4a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0dc215aadb5345d791945658832aae4a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0dc215aadb5345d791945658832aae4a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] Jul 21 10:50:28.882672 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Tenant: tempest-AttachVolumeNegativeTest-692763952 Jul 21 10:50:28.882672 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Tenant-Id: 0dc215aadb5345d791945658832aae4a Jul 21 10:50:28.882672 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-692763952 Jul 21 10:50:28.882672 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User: tempest-AttachVolumeNegativeTest-692763952-project Jul 21 10:50:28.882672 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Domain-Id: default Jul 21 10:50:28.882672 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Domain-Name: Default Jul 21 10:50:28.882672 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Id: 906e4bc4e9cc45ecb01cfca7918e461d Jul 21 10:50:28.882672 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Name: tempest-AttachVolumeNegativeTest-692763952-project Jul 21 10:50:28.882672 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: method: > Jul 21 10:50:28.882672 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: exception: Instance 73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b could not be found. Jul 21 10:50:28.882672 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: action_args: {'id': '73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b'} Jul 21 10:50:28.883530 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 10:50:28.883530 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:50:28.883530 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 10:50:28.883530 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 10:50:28.883530 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 10:50:28.883530 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 10:50:28.883530 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 10:50:28.883530 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 10:50:28.883530 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 10:50:28.883530 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 10:50:28.883530 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b could not be found. Jul 21 10:50:28.883530 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:50:28.883530 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:50:28.883530 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:50:28.883530 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:50:28.883530 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:50:28.883530 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:50:28.883530 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 10:50:28.883530 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 10:50:28.883530 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 10:50:28.884861 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 10:50:28.884861 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 10:50:28.884861 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 10:50:28.884861 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 10:50:28.884861 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 10:50:28.884861 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 10:50:28.884861 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 10:50:28.884861 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b could not be found. Jul 21 10:50:28.884861 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:50:28.884861 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:50:28.884861 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:50:28.884861 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:50:28.884861 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:50:28.884861 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:50:28.884861 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 10:50:28.884861 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 10:50:28.884861 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b could not be found. Jul 21 10:50:28.884861 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:50:28.886048 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-95c3aede-2806-404c-ab86-99227891ac88 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Returning 404 to user: Instance 73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b could not be found. {{(pid=124868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 10:50:28.886048 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-95c3aede-2806-404c-ab86-99227891ac88 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b" status: 404 len: 111 microversion: 2.1 time: 0.030196 Jul 21 10:50:28.886048 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 269/553] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:28 2022] GET /compute/v2.1/servers/73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 10:50:28.887994 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-008a161e-4ef2-4ec7-8ed0-3442f0c0a312 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '.version_select at 0x7f795eb87f70>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:28.960751 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-008a161e-4ef2-4ec7-8ed0-3442f0c0a312 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-789417223" status: 202 len: 0 microversion: 2.1 time: 0.076479 Jul 21 10:50:28.961429 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 285/554] 10.222.0.48 () {58 vars in 1217 bytes} [Thu Jul 21 10:50:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-789417223 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 10:50:29.137756 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-22d7edec-52de-4f6f-8d0b-fdbae75cbcd7 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:29.138963 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-22d7edec-52de-4f6f-8d0b-fdbae75cbcd7 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] [instance: 6597f555-38e1-4d14-bf7c-6d8b5e5a26d4] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:29.144885 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-22d7edec-52de-4f6f-8d0b-fdbae75cbcd7 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:29.145361 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-22d7edec-52de-4f6f-8d0b-fdbae75cbcd7 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:29.146116 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-22d7edec-52de-4f6f-8d0b-fdbae75cbcd7 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:29.146606 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-22d7edec-52de-4f6f-8d0b-fdbae75cbcd7 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:29.150468 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:50:29.297305 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-22d7edec-52de-4f6f-8d0b-fdbae75cbcd7 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0271efe4b4e9592b29d9f124519b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eff05785bd84522ad637d8bed14563d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:29.304970 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-22d7edec-52de-4f6f-8d0b-fdbae75cbcd7 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] 10.222.0.48 "GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4" status: 200 len: 1358 microversion: 2.1 time: 0.171059 Jul 21 10:50:29.305540 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 270/555] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:29 2022] GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:50:29.425061 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-41449e3a-49a5-4c80-baf3-51399b1e812c tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:29.425674 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-41449e3a-49a5-4c80-baf3-51399b1e812c tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] [instance: eb24f843-eeb3-43dd-bd48-3bcf68e344cd] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:29.431922 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-41449e3a-49a5-4c80-baf3-51399b1e812c tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:29.432365 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-41449e3a-49a5-4c80-baf3-51399b1e812c tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:29.433127 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-41449e3a-49a5-4c80-baf3-51399b1e812c tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:29.433558 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-41449e3a-49a5-4c80-baf3-51399b1e812c tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:29.576855 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-41449e3a-49a5-4c80-baf3-51399b1e812c tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e3fd195fd14b009ba56950dc542cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620ea9c4eaa74dc5858cf93d9fcad9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:29.585665 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-41449e3a-49a5-4c80-baf3-51399b1e812c tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] 10.222.0.48 "GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd" status: 200 len: 1260 microversion: 2.1 time: 0.164417 Jul 21 10:50:29.586352 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 286/556] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:29 2022] GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd => generated 1260 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:50:29.631464 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-5f35e9b0-7506-460c-b5b4-b3862876b81f tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:29.632165 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-5f35e9b0-7506-460c-b5b4-b3862876b81f tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: a54643be-3f53-4fe5-bab0-786b71d627bb] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:29.639646 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5f35e9b0-7506-460c-b5b4-b3862876b81f tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:29.640184 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5f35e9b0-7506-460c-b5b4-b3862876b81f tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:29.641097 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5f35e9b0-7506-460c-b5b4-b3862876b81f tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:29.641605 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5f35e9b0-7506-460c-b5b4-b3862876b81f tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:29.782172 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-5f35e9b0-7506-460c-b5b4-b3862876b81f tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:29.788263 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [req-88a86abb-30e0-410b-ab7f-a4ba1bddf4f8 req-9c29b156-b5cd-4dd6-86c8-9152d28124e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6597f555-38e1-4d14-bf7c-6d8b5e5a26d4", "name": "network-vif-plugged", "status": "completed", "tag": "24113ecd-45f8-473c-a1aa-fc93cff6c402"}, {"server_uuid": "eb24f843-eeb3-43dd-bd48-3bcf68e344cd", "name": "network-vif-plugged", "status": "completed", "tag": "2741d1f0-6bcb-4bee-8842-bc9bf8bc4db2"}]} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:50:29.791072 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-5f35e9b0-7506-460c-b5b4-b3862876b81f tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb" status: 200 len: 1736 microversion: 2.1 time: 0.164095 Jul 21 10:50:29.791846 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 271/557] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:29 2022] GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:50:29.798514 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-88a86abb-30e0-410b-ab7f-a4ba1bddf4f8 req-9c29b156-b5cd-4dd6-86c8-9152d28124e2 service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:29.798773 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-88a86abb-30e0-410b-ab7f-a4ba1bddf4f8 req-9c29b156-b5cd-4dd6-86c8-9152d28124e2 service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:29.810331 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-99db6f2a-10ea-4985-a303-374af99e9dca tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:29.810999 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-99db6f2a-10ea-4985-a303-374af99e9dca tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:29.811394 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.compute.server_external_events [req-88a86abb-30e0-410b-ab7f-a4ba1bddf4f8 req-9c29b156-b5cd-4dd6-86c8-9152d28124e2 service nova] Creating event network-vif-plugged:24113ecd-45f8-473c-a1aa-fc93cff6c402 for instance 6597f555-38e1-4d14-bf7c-6d8b5e5a26d4 on hv-cinder-84980 Jul 21 10:50:29.811906 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.compute.server_external_events [req-88a86abb-30e0-410b-ab7f-a4ba1bddf4f8 req-9c29b156-b5cd-4dd6-86c8-9152d28124e2 service nova] Creating event network-vif-plugged:2741d1f0-6bcb-4bee-8842-bc9bf8bc4db2 for instance eb24f843-eeb3-43dd-bd48-3bcf68e344cd on hv-cinder-84980 Jul 21 10:50:29.818325 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [req-88a86abb-30e0-410b-ab7f-a4ba1bddf4f8 req-9c29b156-b5cd-4dd6-86c8-9152d28124e2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.034229 Jul 21 10:50:29.820057 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-99db6f2a-10ea-4985-a303-374af99e9dca tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:29.820057 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-99db6f2a-10ea-4985-a303-374af99e9dca tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:29.820312 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 287/558] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 21 10:50:29 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 10:50:29.820416 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-99db6f2a-10ea-4985-a303-374af99e9dca tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:29.820416 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-99db6f2a-10ea-4985-a303-374af99e9dca tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:29.846512 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-c1dce523-8e83-479d-83df-ed923344e8f3 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:29.847239 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-c1dce523-8e83-479d-83df-ed923344e8f3 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] [instance: 082cef74-9509-4b17-8250-cd6527a6e3eb] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:29.853451 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c1dce523-8e83-479d-83df-ed923344e8f3 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:29.853906 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c1dce523-8e83-479d-83df-ed923344e8f3 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:29.854696 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c1dce523-8e83-479d-83df-ed923344e8f3 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:29.855137 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c1dce523-8e83-479d-83df-ed923344e8f3 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:29.944904 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-c1dce523-8e83-479d-83df-ed923344e8f3 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ccc2d61c7045a8abba95e7cd002a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24d5a2477eb74d5da5911b37f9031110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:29.953989 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-c1dce523-8e83-479d-83df-ed923344e8f3 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] 10.222.0.48 "GET /compute/v2.1/servers/082cef74-9509-4b17-8250-cd6527a6e3eb" status: 200 len: 1223 microversion: 2.1 time: 0.112447 Jul 21 10:50:29.963487 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 288/559] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:29 2022] GET /compute/v2.1/servers/082cef74-9509-4b17-8250-cd6527a6e3eb => generated 1223 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:50:29.991148 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-99db6f2a-10ea-4985-a303-374af99e9dca tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:30.000906 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-99db6f2a-10ea-4985-a303-374af99e9dca tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:30.002893 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-99db6f2a-10ea-4985-a303-374af99e9dca tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:30.011570 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-99db6f2a-10ea-4985-a303-374af99e9dca tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1808 microversion: 2.20 time: 0.204894 Jul 21 10:50:30.012164 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 272/560] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:50:29 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1808 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 10:50:30.091090 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-6261c4cf-5ce3-4553-958e-313e50ecb0cd tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:30.092575 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-6261c4cf-5ce3-4553-958e-313e50ecb0cd tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 691ae8fc-92e7-4940-99d8-7edb5a96d2f3] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:30.098826 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6261c4cf-5ce3-4553-958e-313e50ecb0cd tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:30.099307 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6261c4cf-5ce3-4553-958e-313e50ecb0cd tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:30.100072 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6261c4cf-5ce3-4553-958e-313e50ecb0cd tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:30.100499 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6261c4cf-5ce3-4553-958e-313e50ecb0cd tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:30.200379 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.objects.instance [None req-6261c4cf-5ce3-4553-958e-313e50ecb0cd tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lazy-loading 'services' on Instance uuid 691ae8fc-92e7-4940-99d8-7edb5a96d2f3 {{(pid=124867) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 10:50:30.322756 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-562e025f-69f1-47ce-ad10-d02de8ffd915 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:30.323353 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-562e025f-69f1-47ce-ad10-d02de8ffd915 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] [instance: 6597f555-38e1-4d14-bf7c-6d8b5e5a26d4] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:30.329927 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-562e025f-69f1-47ce-ad10-d02de8ffd915 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:30.330381 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-562e025f-69f1-47ce-ad10-d02de8ffd915 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:30.331146 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-562e025f-69f1-47ce-ad10-d02de8ffd915 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:30.331573 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-562e025f-69f1-47ce-ad10-d02de8ffd915 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:30.410380 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-6261c4cf-5ce3-4553-958e-313e50ecb0cd tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "DELETE /compute/v2.1/servers/691ae8fc-92e7-4940-99d8-7edb5a96d2f3/os-volume_attachments/5314c7de-a97a-4a8b-adc5-7761fd65219f" status: 202 len: 0 microversion: 2.1 time: 0.324406 Jul 21 10:50:30.411009 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 289/561] 10.222.0.48 () {58 vars in 1415 bytes} [Thu Jul 21 10:50:30 2022] DELETE /compute/v2.1/servers/691ae8fc-92e7-4940-99d8-7edb5a96d2f3/os-volume_attachments/5314c7de-a97a-4a8b-adc5-7761fd65219f => generated 0 bytes in 326 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 10:50:30.428086 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-eba0df26-b3d8-40cb-8aa7-de3ef99b2e5c tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:30.428086 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-eba0df26-b3d8-40cb-8aa7-de3ef99b2e5c tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 691ae8fc-92e7-4940-99d8-7edb5a96d2f3] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:30.428086 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-eba0df26-b3d8-40cb-8aa7-de3ef99b2e5c tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:30.428086 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-eba0df26-b3d8-40cb-8aa7-de3ef99b2e5c tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:30.428853 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-eba0df26-b3d8-40cb-8aa7-de3ef99b2e5c tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:30.429238 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-eba0df26-b3d8-40cb-8aa7-de3ef99b2e5c tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:30.463869 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-eba0df26-b3d8-40cb-8aa7-de3ef99b2e5c tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/691ae8fc-92e7-4940-99d8-7edb5a96d2f3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048320 Jul 21 10:50:30.464647 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 290/562] 10.222.0.48 () {58 vars in 1301 bytes} [Thu Jul 21 10:50:30 2022] GET /compute/v2.1/servers/691ae8fc-92e7-4940-99d8-7edb5a96d2f3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 10:50:30.468496 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-562e025f-69f1-47ce-ad10-d02de8ffd915 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0271efe4b4e9592b29d9f124519b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eff05785bd84522ad637d8bed14563d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:30.476255 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-562e025f-69f1-47ce-ad10-d02de8ffd915 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] 10.222.0.48 "GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4" status: 200 len: 1358 microversion: 2.1 time: 0.157314 Jul 21 10:50:30.476868 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 273/563] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:30 2022] GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:50:30.604079 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-fb7a6fd9-5a31-44d2-972d-e4612094326c tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:30.604692 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-fb7a6fd9-5a31-44d2-972d-e4612094326c tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] [instance: eb24f843-eeb3-43dd-bd48-3bcf68e344cd] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:30.611979 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fb7a6fd9-5a31-44d2-972d-e4612094326c tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:30.613517 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fb7a6fd9-5a31-44d2-972d-e4612094326c tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:30.613517 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fb7a6fd9-5a31-44d2-972d-e4612094326c tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:30.613740 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fb7a6fd9-5a31-44d2-972d-e4612094326c tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:30.618236 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:50:30.772889 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-fb7a6fd9-5a31-44d2-972d-e4612094326c tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e3fd195fd14b009ba56950dc542cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620ea9c4eaa74dc5858cf93d9fcad9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:30.787627 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-fb7a6fd9-5a31-44d2-972d-e4612094326c tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] 10.222.0.48 "GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd" status: 200 len: 1260 microversion: 2.1 time: 0.187321 Jul 21 10:50:30.794232 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 291/564] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:30 2022] GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd => generated 1260 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:50:30.809247 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-09952320-7f99-4fdb-8840-3ae1349e28df tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:30.809844 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-09952320-7f99-4fdb-8840-3ae1349e28df tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: a54643be-3f53-4fe5-bab0-786b71d627bb] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:30.816362 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-09952320-7f99-4fdb-8840-3ae1349e28df tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:30.817020 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-09952320-7f99-4fdb-8840-3ae1349e28df tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:30.817888 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-09952320-7f99-4fdb-8840-3ae1349e28df tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:30.818322 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-09952320-7f99-4fdb-8840-3ae1349e28df tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:30.951340 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-09952320-7f99-4fdb-8840-3ae1349e28df tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:30.959315 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-09952320-7f99-4fdb-8840-3ae1349e28df tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb" status: 200 len: 1736 microversion: 2.1 time: 0.154023 Jul 21 10:50:30.959878 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 274/565] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:30 2022] GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:50:30.972218 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-e1c7ca3b-f838-4a72-b989-46c7a12d76f9 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:30.972822 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-e1c7ca3b-f838-4a72-b989-46c7a12d76f9 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] [instance: 082cef74-9509-4b17-8250-cd6527a6e3eb] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:30.978624 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e1c7ca3b-f838-4a72-b989-46c7a12d76f9 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:30.984389 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e1c7ca3b-f838-4a72-b989-46c7a12d76f9 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:30.984389 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e1c7ca3b-f838-4a72-b989-46c7a12d76f9 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:30.984389 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e1c7ca3b-f838-4a72-b989-46c7a12d76f9 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:31.032942 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-b5c1005c-66f9-4306-86f0-c6dda702b4b6 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:31.033654 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-b5c1005c-66f9-4306-86f0-c6dda702b4b6 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:31.039688 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b5c1005c-66f9-4306-86f0-c6dda702b4b6 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:31.040133 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b5c1005c-66f9-4306-86f0-c6dda702b4b6 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:31.040884 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b5c1005c-66f9-4306-86f0-c6dda702b4b6 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:31.041124 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-e1c7ca3b-f838-4a72-b989-46c7a12d76f9 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ccc2d61c7045a8abba95e7cd002a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24d5a2477eb74d5da5911b37f9031110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:31.041339 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b5c1005c-66f9-4306-86f0-c6dda702b4b6 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:31.048834 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-e1c7ca3b-f838-4a72-b989-46c7a12d76f9 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] 10.222.0.48 "GET /compute/v2.1/servers/082cef74-9509-4b17-8250-cd6527a6e3eb" status: 200 len: 1271 microversion: 2.1 time: 0.080420 Jul 21 10:50:31.049488 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 292/566] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:30 2022] GET /compute/v2.1/servers/082cef74-9509-4b17-8250-cd6527a6e3eb => generated 1271 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:50:31.197690 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-b5c1005c-66f9-4306-86f0-c6dda702b4b6 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:31.208500 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-b5c1005c-66f9-4306-86f0-c6dda702b4b6 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:31.209956 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-b5c1005c-66f9-4306-86f0-c6dda702b4b6 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:31.211204 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-b5c1005c-66f9-4306-86f0-c6dda702b4b6 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1808 microversion: 2.20 time: 0.183284 Jul 21 10:50:31.211761 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 275/567] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:50:31 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1808 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 10:50:31.476764 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-0701ddc1-3281-40ff-ba50-4d9c3f93086d tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:31.477635 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-0701ddc1-3281-40ff-ba50-4d9c3f93086d tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 691ae8fc-92e7-4940-99d8-7edb5a96d2f3] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:31.484460 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0701ddc1-3281-40ff-ba50-4d9c3f93086d tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:31.484912 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0701ddc1-3281-40ff-ba50-4d9c3f93086d tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:31.485672 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0701ddc1-3281-40ff-ba50-4d9c3f93086d tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:31.486107 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0701ddc1-3281-40ff-ba50-4d9c3f93086d tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:31.492921 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-1eaa87d4-ab6d-4e8a-9ee7-dd7a07a75994 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:31.493606 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-1eaa87d4-ab6d-4e8a-9ee7-dd7a07a75994 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] [instance: 6597f555-38e1-4d14-bf7c-6d8b5e5a26d4] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:31.500950 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1eaa87d4-ab6d-4e8a-9ee7-dd7a07a75994 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:31.500950 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1eaa87d4-ab6d-4e8a-9ee7-dd7a07a75994 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:31.501717 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1eaa87d4-ab6d-4e8a-9ee7-dd7a07a75994 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:31.502142 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1eaa87d4-ab6d-4e8a-9ee7-dd7a07a75994 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:31.516109 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-0701ddc1-3281-40ff-ba50-4d9c3f93086d tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/691ae8fc-92e7-4940-99d8-7edb5a96d2f3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043328 Jul 21 10:50:31.516677 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 293/568] 10.222.0.48 () {58 vars in 1301 bytes} [Thu Jul 21 10:50:31 2022] GET /compute/v2.1/servers/691ae8fc-92e7-4940-99d8-7edb5a96d2f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:50:31.635742 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-1eaa87d4-ab6d-4e8a-9ee7-dd7a07a75994 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0271efe4b4e9592b29d9f124519b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eff05785bd84522ad637d8bed14563d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:31.643935 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-1eaa87d4-ab6d-4e8a-9ee7-dd7a07a75994 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] 10.222.0.48 "GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4" status: 200 len: 1358 microversion: 2.1 time: 0.154742 Jul 21 10:50:31.644506 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 276/569] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:31 2022] GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:50:31.804439 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-df276144-7388-4638-8a6d-2656118d8885 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:31.804976 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-df276144-7388-4638-8a6d-2656118d8885 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] [instance: eb24f843-eeb3-43dd-bd48-3bcf68e344cd] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:31.811736 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-df276144-7388-4638-8a6d-2656118d8885 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:31.813376 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-df276144-7388-4638-8a6d-2656118d8885 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:31.813376 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-df276144-7388-4638-8a6d-2656118d8885 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:31.813376 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-df276144-7388-4638-8a6d-2656118d8885 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:31.948019 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-df276144-7388-4638-8a6d-2656118d8885 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e3fd195fd14b009ba56950dc542cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620ea9c4eaa74dc5858cf93d9fcad9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:31.956048 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-df276144-7388-4638-8a6d-2656118d8885 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] 10.222.0.48 "GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd" status: 200 len: 1260 microversion: 2.1 time: 0.155538 Jul 21 10:50:31.962658 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 294/570] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:31 2022] GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:50:31.976961 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-68c813c2-4f05-4a0d-9833-1004e653944b tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:31.977562 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-68c813c2-4f05-4a0d-9833-1004e653944b tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: a54643be-3f53-4fe5-bab0-786b71d627bb] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:31.984868 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-68c813c2-4f05-4a0d-9833-1004e653944b tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:31.987210 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-68c813c2-4f05-4a0d-9833-1004e653944b tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:31.987210 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-68c813c2-4f05-4a0d-9833-1004e653944b tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:31.987210 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-68c813c2-4f05-4a0d-9833-1004e653944b tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:32.066132 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-2c540fec-1a85-47d9-9f2c-d8c70627d668 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:32.066767 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-2c540fec-1a85-47d9-9f2c-d8c70627d668 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] [instance: 082cef74-9509-4b17-8250-cd6527a6e3eb] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:32.072775 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2c540fec-1a85-47d9-9f2c-d8c70627d668 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:32.073224 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2c540fec-1a85-47d9-9f2c-d8c70627d668 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:32.073989 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2c540fec-1a85-47d9-9f2c-d8c70627d668 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:32.074421 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2c540fec-1a85-47d9-9f2c-d8c70627d668 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:32.125640 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-68c813c2-4f05-4a0d-9833-1004e653944b tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:32.133510 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-68c813c2-4f05-4a0d-9833-1004e653944b tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb" status: 200 len: 1736 microversion: 2.1 time: 0.160308 Jul 21 10:50:32.140565 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 277/571] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:31 2022] GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:50:32.141147 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-2c540fec-1a85-47d9-9f2c-d8c70627d668 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ccc2d61c7045a8abba95e7cd002a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24d5a2477eb74d5da5911b37f9031110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:32.148472 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-2c540fec-1a85-47d9-9f2c-d8c70627d668 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] 10.222.0.48 "GET /compute/v2.1/servers/082cef74-9509-4b17-8250-cd6527a6e3eb" status: 200 len: 1271 microversion: 2.1 time: 0.086259 Jul 21 10:50:32.149023 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 295/572] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:32 2022] GET /compute/v2.1/servers/082cef74-9509-4b17-8250-cd6527a6e3eb => generated 1271 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:50:32.229613 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-6d2ab778-0815-46be-90c0-2c4bef11be35 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:32.230210 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-6d2ab778-0815-46be-90c0-2c4bef11be35 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:32.237258 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6d2ab778-0815-46be-90c0-2c4bef11be35 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:32.237722 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6d2ab778-0815-46be-90c0-2c4bef11be35 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:32.238448 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6d2ab778-0815-46be-90c0-2c4bef11be35 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:32.238894 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6d2ab778-0815-46be-90c0-2c4bef11be35 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:32.373199 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-6d2ab778-0815-46be-90c0-2c4bef11be35 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:32.381388 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-6d2ab778-0815-46be-90c0-2c4bef11be35 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:32.382905 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-6d2ab778-0815-46be-90c0-2c4bef11be35 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:32.384035 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-6d2ab778-0815-46be-90c0-2c4bef11be35 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1795 microversion: 2.20 time: 0.158297 Jul 21 10:50:32.384584 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 278/573] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:50:32 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1795 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:50:32.527342 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-9315333f-3865-441c-88a3-0da87166ac74 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:32.528268 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-9315333f-3865-441c-88a3-0da87166ac74 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 691ae8fc-92e7-4940-99d8-7edb5a96d2f3] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:32.534902 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9315333f-3865-441c-88a3-0da87166ac74 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:32.535348 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9315333f-3865-441c-88a3-0da87166ac74 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:32.536090 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9315333f-3865-441c-88a3-0da87166ac74 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:32.536522 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9315333f-3865-441c-88a3-0da87166ac74 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:32.565171 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-9315333f-3865-441c-88a3-0da87166ac74 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/691ae8fc-92e7-4940-99d8-7edb5a96d2f3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041838 Jul 21 10:50:32.565714 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 296/574] 10.222.0.48 () {58 vars in 1301 bytes} [Thu Jul 21 10:50:32 2022] GET /compute/v2.1/servers/691ae8fc-92e7-4940-99d8-7edb5a96d2f3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:50:32.661096 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-966a0c6c-4292-4ff8-846d-dce751df8d9a tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:32.661708 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-966a0c6c-4292-4ff8-846d-dce751df8d9a tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] [instance: 6597f555-38e1-4d14-bf7c-6d8b5e5a26d4] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:32.668276 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-966a0c6c-4292-4ff8-846d-dce751df8d9a tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:32.669123 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-966a0c6c-4292-4ff8-846d-dce751df8d9a tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:32.669583 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-966a0c6c-4292-4ff8-846d-dce751df8d9a tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:32.670003 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-966a0c6c-4292-4ff8-846d-dce751df8d9a tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:32.800231 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-966a0c6c-4292-4ff8-846d-dce751df8d9a tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0271efe4b4e9592b29d9f124519b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eff05785bd84522ad637d8bed14563d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:32.807526 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-966a0c6c-4292-4ff8-846d-dce751df8d9a tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] 10.222.0.48 "GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4" status: 200 len: 1358 microversion: 2.1 time: 0.150550 Jul 21 10:50:32.808089 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 279/575] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:32 2022] GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:50:32.973135 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-b4afbf36-addb-4306-8918-c77cec7466e1 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:32.973648 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-b4afbf36-addb-4306-8918-c77cec7466e1 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] [instance: eb24f843-eeb3-43dd-bd48-3bcf68e344cd] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:32.979802 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b4afbf36-addb-4306-8918-c77cec7466e1 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:32.980249 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b4afbf36-addb-4306-8918-c77cec7466e1 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:32.981003 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b4afbf36-addb-4306-8918-c77cec7466e1 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:32.981436 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b4afbf36-addb-4306-8918-c77cec7466e1 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:33.120908 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-b4afbf36-addb-4306-8918-c77cec7466e1 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e3fd195fd14b009ba56950dc542cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620ea9c4eaa74dc5858cf93d9fcad9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:33.128472 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-b4afbf36-addb-4306-8918-c77cec7466e1 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] 10.222.0.48 "GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd" status: 200 len: 1260 microversion: 2.1 time: 0.159219 Jul 21 10:50:33.129034 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 297/576] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:32 2022] GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:50:33.150960 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-4955c362-b489-4f23-9df7-7c0e6026cdc0 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:33.151570 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-4955c362-b489-4f23-9df7-7c0e6026cdc0 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: a54643be-3f53-4fe5-bab0-786b71d627bb] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:33.158843 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4955c362-b489-4f23-9df7-7c0e6026cdc0 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:33.159293 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4955c362-b489-4f23-9df7-7c0e6026cdc0 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:33.160141 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4955c362-b489-4f23-9df7-7c0e6026cdc0 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:33.160582 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4955c362-b489-4f23-9df7-7c0e6026cdc0 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:33.166091 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-6ae53ad8-347a-4713-9845-cf1395023467 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:33.166091 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-6ae53ad8-347a-4713-9845-cf1395023467 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] [instance: 082cef74-9509-4b17-8250-cd6527a6e3eb] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:33.169056 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:50:33.174659 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6ae53ad8-347a-4713-9845-cf1395023467 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:33.175245 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6ae53ad8-347a-4713-9845-cf1395023467 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:33.176129 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6ae53ad8-347a-4713-9845-cf1395023467 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:33.176639 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6ae53ad8-347a-4713-9845-cf1395023467 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:33.257211 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-6ae53ad8-347a-4713-9845-cf1395023467 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ccc2d61c7045a8abba95e7cd002a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24d5a2477eb74d5da5911b37f9031110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:33.265922 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-6ae53ad8-347a-4713-9845-cf1395023467 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] 10.222.0.48 "GET /compute/v2.1/servers/082cef74-9509-4b17-8250-cd6527a6e3eb" status: 200 len: 1279 microversion: 2.1 time: 0.103910 Jul 21 10:50:33.266516 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 298/577] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:33 2022] GET /compute/v2.1/servers/082cef74-9509-4b17-8250-cd6527a6e3eb => generated 1279 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:50:33.325419 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-4955c362-b489-4f23-9df7-7c0e6026cdc0 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:33.335617 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-4955c362-b489-4f23-9df7-7c0e6026cdc0 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb" status: 200 len: 1736 microversion: 2.1 time: 0.188512 Jul 21 10:50:33.336471 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 280/578] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:33 2022] GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb => generated 1736 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:50:33.576530 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-5a1f7379-fd71-47be-b0af-ed23cca23f06 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:33.577401 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-5a1f7379-fd71-47be-b0af-ed23cca23f06 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 691ae8fc-92e7-4940-99d8-7edb5a96d2f3] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:33.584581 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5a1f7379-fd71-47be-b0af-ed23cca23f06 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:33.585028 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5a1f7379-fd71-47be-b0af-ed23cca23f06 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:33.585782 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5a1f7379-fd71-47be-b0af-ed23cca23f06 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:33.586215 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5a1f7379-fd71-47be-b0af-ed23cca23f06 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:33.614838 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-5a1f7379-fd71-47be-b0af-ed23cca23f06 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/691ae8fc-92e7-4940-99d8-7edb5a96d2f3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042480 Jul 21 10:50:33.615387 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 299/579] 10.222.0.48 () {58 vars in 1301 bytes} [Thu Jul 21 10:50:33 2022] GET /compute/v2.1/servers/691ae8fc-92e7-4940-99d8-7edb5a96d2f3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:50:33.824719 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-b5f9a974-bf5c-4781-8620-714cc5f8c62a tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:33.825319 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-b5f9a974-bf5c-4781-8620-714cc5f8c62a tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] [instance: 6597f555-38e1-4d14-bf7c-6d8b5e5a26d4] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:33.831671 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b5f9a974-bf5c-4781-8620-714cc5f8c62a tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:33.832050 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b5f9a974-bf5c-4781-8620-714cc5f8c62a tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:33.832804 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b5f9a974-bf5c-4781-8620-714cc5f8c62a tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:33.833231 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b5f9a974-bf5c-4781-8620-714cc5f8c62a tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:33.977183 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-b5f9a974-bf5c-4781-8620-714cc5f8c62a tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0271efe4b4e9592b29d9f124519b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eff05785bd84522ad637d8bed14563d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:33.988971 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-b5f9a974-bf5c-4781-8620-714cc5f8c62a tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] 10.222.0.48 "GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4" status: 200 len: 1358 microversion: 2.1 time: 0.168126 Jul 21 10:50:33.989549 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 281/580] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:33 2022] GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:50:34.145077 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-0905fff5-6919-4874-8fff-7c543c6ec22e tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:34.145678 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-0905fff5-6919-4874-8fff-7c543c6ec22e tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] [instance: eb24f843-eeb3-43dd-bd48-3bcf68e344cd] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:34.151799 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0905fff5-6919-4874-8fff-7c543c6ec22e tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:34.152245 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0905fff5-6919-4874-8fff-7c543c6ec22e tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:34.152997 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0905fff5-6919-4874-8fff-7c543c6ec22e tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:34.153433 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0905fff5-6919-4874-8fff-7c543c6ec22e tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:34.284755 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-faf3f30d-bcc8-42a3-8ef5-f76cb788dd0b tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:34.285499 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-faf3f30d-bcc8-42a3-8ef5-f76cb788dd0b tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] [instance: 082cef74-9509-4b17-8250-cd6527a6e3eb] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:34.287173 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-0905fff5-6919-4874-8fff-7c543c6ec22e tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e3fd195fd14b009ba56950dc542cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620ea9c4eaa74dc5858cf93d9fcad9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:34.292145 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-faf3f30d-bcc8-42a3-8ef5-f76cb788dd0b tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:34.292646 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-faf3f30d-bcc8-42a3-8ef5-f76cb788dd0b tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:34.293386 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-faf3f30d-bcc8-42a3-8ef5-f76cb788dd0b tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:34.293846 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-faf3f30d-bcc8-42a3-8ef5-f76cb788dd0b tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:34.295375 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-0905fff5-6919-4874-8fff-7c543c6ec22e tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] 10.222.0.48 "GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd" status: 200 len: 1445 microversion: 2.1 time: 0.154066 Jul 21 10:50:34.296050 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 300/581] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:34 2022] GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd => generated 1445 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:50:34.313603 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-8574d10e-737a-4735-b94f-2665dceae052 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:34.314340 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-8574d10e-737a-4735-b94f-2665dceae052 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] [instance: eb24f843-eeb3-43dd-bd48-3bcf68e344cd] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:34.320918 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8574d10e-737a-4735-b94f-2665dceae052 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:34.321489 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8574d10e-737a-4735-b94f-2665dceae052 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:34.322355 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8574d10e-737a-4735-b94f-2665dceae052 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:34.322922 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8574d10e-737a-4735-b94f-2665dceae052 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:34.362253 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-faf3f30d-bcc8-42a3-8ef5-f76cb788dd0b tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ccc2d61c7045a8abba95e7cd002a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24d5a2477eb74d5da5911b37f9031110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:34.369810 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-faf3f30d-bcc8-42a3-8ef5-f76cb788dd0b tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] 10.222.0.48 "GET /compute/v2.1/servers/082cef74-9509-4b17-8250-cd6527a6e3eb" status: 200 len: 1277 microversion: 2.1 time: 0.090372 Jul 21 10:50:34.374799 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 282/582] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:34 2022] GET /compute/v2.1/servers/082cef74-9509-4b17-8250-cd6527a6e3eb => generated 1277 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:50:34.379038 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-c9b408f2-79e6-441c-a62d-331488465c65 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:34.379808 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-c9b408f2-79e6-441c-a62d-331488465c65 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: a54643be-3f53-4fe5-bab0-786b71d627bb] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:34.386586 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c9b408f2-79e6-441c-a62d-331488465c65 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:34.387072 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c9b408f2-79e6-441c-a62d-331488465c65 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:34.388471 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c9b408f2-79e6-441c-a62d-331488465c65 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:34.388471 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c9b408f2-79e6-441c-a62d-331488465c65 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:34.522446 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-8574d10e-737a-4735-b94f-2665dceae052 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e3fd195fd14b009ba56950dc542cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620ea9c4eaa74dc5858cf93d9fcad9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:34.531005 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-8574d10e-737a-4735-b94f-2665dceae052 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] 10.222.0.48 "GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd" status: 200 len: 1445 microversion: 2.1 time: 0.221598 Jul 21 10:50:34.531668 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 301/583] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:34 2022] GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd => generated 1445 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:50:34.566495 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-c9b408f2-79e6-441c-a62d-331488465c65 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:34.574853 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-c9b408f2-79e6-441c-a62d-331488465c65 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb" status: 200 len: 1736 microversion: 2.1 time: 0.203462 Jul 21 10:50:34.575423 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 283/584] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:34 2022] GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb => generated 1736 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:50:34.628164 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-d0a0ac45-0338-434c-ae22-d13e5674b0b5 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:34.629204 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-d0a0ac45-0338-434c-ae22-d13e5674b0b5 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 691ae8fc-92e7-4940-99d8-7edb5a96d2f3] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:34.635515 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d0a0ac45-0338-434c-ae22-d13e5674b0b5 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:34.635968 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d0a0ac45-0338-434c-ae22-d13e5674b0b5 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:34.637213 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d0a0ac45-0338-434c-ae22-d13e5674b0b5 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:34.637652 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d0a0ac45-0338-434c-ae22-d13e5674b0b5 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:34.671117 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-d0a0ac45-0338-434c-ae22-d13e5674b0b5 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/691ae8fc-92e7-4940-99d8-7edb5a96d2f3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048205 Jul 21 10:50:34.671360 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 302/585] 10.222.0.48 () {58 vars in 1301 bytes} [Thu Jul 21 10:50:34 2022] GET /compute/v2.1/servers/691ae8fc-92e7-4940-99d8-7edb5a96d2f3/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 21 10:50:34.731469 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-ac3cc032-6f4b-4e41-bd07-3e0798c24203 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:34.731972 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-ac3cc032-6f4b-4e41-bd07-3e0798c24203 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 691ae8fc-92e7-4940-99d8-7edb5a96d2f3] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:34.738795 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ac3cc032-6f4b-4e41-bd07-3e0798c24203 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:34.739768 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ac3cc032-6f4b-4e41-bd07-3e0798c24203 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:34.740541 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ac3cc032-6f4b-4e41-bd07-3e0798c24203 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:34.740988 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ac3cc032-6f4b-4e41-bd07-3e0798c24203 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:34.776181 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-ac3cc032-6f4b-4e41-bd07-3e0798c24203 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 691ae8fc-92e7-4940-99d8-7edb5a96d2f3] Going to try to terminate instance {{(pid=124868) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 10:50:35.008548 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-f463306a-06d5-4c27-9ff6-050d9c2a23ec tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:35.009159 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-f463306a-06d5-4c27-9ff6-050d9c2a23ec tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] [instance: 6597f555-38e1-4d14-bf7c-6d8b5e5a26d4] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:35.017522 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f463306a-06d5-4c27-9ff6-050d9c2a23ec tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:35.017986 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f463306a-06d5-4c27-9ff6-050d9c2a23ec tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:35.018784 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f463306a-06d5-4c27-9ff6-050d9c2a23ec tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:35.019494 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f463306a-06d5-4c27-9ff6-050d9c2a23ec tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:35.051804 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-ac3cc032-6f4b-4e41-bd07-3e0798c24203 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "DELETE /compute/v2.1/servers/691ae8fc-92e7-4940-99d8-7edb5a96d2f3" status: 204 len: 0 microversion: 2.1 time: 0.323853 Jul 21 10:50:35.052520 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 284/586] 10.222.0.48 () {58 vars in 1238 bytes} [Thu Jul 21 10:50:34 2022] DELETE /compute/v2.1/servers/691ae8fc-92e7-4940-99d8-7edb5a96d2f3 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 10:50:35.062132 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-4a1942a6-c1d1-4f2e-b887-ea19fbb08b9f tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:35.063519 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-4a1942a6-c1d1-4f2e-b887-ea19fbb08b9f tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 691ae8fc-92e7-4940-99d8-7edb5a96d2f3] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:35.069652 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4a1942a6-c1d1-4f2e-b887-ea19fbb08b9f tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:35.070145 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4a1942a6-c1d1-4f2e-b887-ea19fbb08b9f tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:35.070946 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4a1942a6-c1d1-4f2e-b887-ea19fbb08b9f tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:35.071375 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4a1942a6-c1d1-4f2e-b887-ea19fbb08b9f tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:35.075857 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:50:35.323030 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-f463306a-06d5-4c27-9ff6-050d9c2a23ec tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0271efe4b4e9592b29d9f124519b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eff05785bd84522ad637d8bed14563d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:35.328866 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-4a1942a6-c1d1-4f2e-b887-ea19fbb08b9f tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906e4bc4e9cc45ecb01cfca7918e461d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc215aadb5345d791945658832aae4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:35.343777 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-f463306a-06d5-4c27-9ff6-050d9c2a23ec tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] 10.222.0.48 "GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4" status: 200 len: 1547 microversion: 2.1 time: 0.341560 Jul 21 10:50:35.344378 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 303/587] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:35 2022] GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4 => generated 1547 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:50:35.345793 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-4a1942a6-c1d1-4f2e-b887-ea19fbb08b9f tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/691ae8fc-92e7-4940-99d8-7edb5a96d2f3" status: 200 len: 1682 microversion: 2.1 time: 0.284819 Jul 21 10:50:35.346564 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 285/588] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:35 2022] GET /compute/v2.1/servers/691ae8fc-92e7-4940-99d8-7edb5a96d2f3 => generated 1682 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:50:35.365397 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-6de2ff6e-6143-4dbe-8112-c02f6aa4402c tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:35.365999 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-6de2ff6e-6143-4dbe-8112-c02f6aa4402c tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] [instance: 6597f555-38e1-4d14-bf7c-6d8b5e5a26d4] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:35.372054 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6de2ff6e-6143-4dbe-8112-c02f6aa4402c tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:35.372495 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6de2ff6e-6143-4dbe-8112-c02f6aa4402c tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:35.374116 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6de2ff6e-6143-4dbe-8112-c02f6aa4402c tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:35.378784 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6de2ff6e-6143-4dbe-8112-c02f6aa4402c tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:35.387838 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-c31356eb-52cf-4674-a930-501430238eaf tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:35.388466 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-c31356eb-52cf-4674-a930-501430238eaf tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] [instance: 082cef74-9509-4b17-8250-cd6527a6e3eb] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:35.395676 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c31356eb-52cf-4674-a930-501430238eaf tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:35.396647 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c31356eb-52cf-4674-a930-501430238eaf tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:35.397224 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c31356eb-52cf-4674-a930-501430238eaf tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:35.397594 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c31356eb-52cf-4674-a930-501430238eaf tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:35.944756 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-6de2ff6e-6143-4dbe-8112-c02f6aa4402c tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0271efe4b4e9592b29d9f124519b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eff05785bd84522ad637d8bed14563d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:35.953054 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-6de2ff6e-6143-4dbe-8112-c02f6aa4402c tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] 10.222.0.48 "GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4" status: 200 len: 1547 microversion: 2.1 time: 0.591339 Jul 21 10:50:35.953632 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 304/589] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:35 2022] GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4 => generated 1547 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:50:35.969036 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-e45eb3ae-36fb-4367-b8b8-d26f6b3ff6bd tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:35.969642 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-e45eb3ae-36fb-4367-b8b8-d26f6b3ff6bd tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: a54643be-3f53-4fe5-bab0-786b71d627bb] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:35.975553 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e45eb3ae-36fb-4367-b8b8-d26f6b3ff6bd tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:35.976000 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e45eb3ae-36fb-4367-b8b8-d26f6b3ff6bd tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:35.976764 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e45eb3ae-36fb-4367-b8b8-d26f6b3ff6bd tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:35.977194 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e45eb3ae-36fb-4367-b8b8-d26f6b3ff6bd tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:35.982070 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-c31356eb-52cf-4674-a930-501430238eaf tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ccc2d61c7045a8abba95e7cd002a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24d5a2477eb74d5da5911b37f9031110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:35.989962 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-c31356eb-52cf-4674-a930-501430238eaf tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] 10.222.0.48 "GET /compute/v2.1/servers/082cef74-9509-4b17-8250-cd6527a6e3eb" status: 200 len: 1319 microversion: 2.1 time: 0.606052 Jul 21 10:50:35.990663 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 286/590] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:35 2022] GET /compute/v2.1/servers/082cef74-9509-4b17-8250-cd6527a6e3eb => generated 1319 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:50:35.995277 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [req-2ea5076c-8710-45b8-a590-031b2e03bc97 req-073827c1-b4e1-4ccb-a724-3703e8ccd440 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "082cef74-9509-4b17-8250-cd6527a6e3eb", "tag": "9b9a006a-5edb-47a3-8eaf-9ce87c8cab27"}]} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:50:36.003641 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-2ea5076c-8710-45b8-a590-031b2e03bc97 req-073827c1-b4e1-4ccb-a724-3703e8ccd440 service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:36.004164 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-2ea5076c-8710-45b8-a590-031b2e03bc97 req-073827c1-b4e1-4ccb-a724-3703e8ccd440 service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:36.016595 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.compute.server_external_events [req-2ea5076c-8710-45b8-a590-031b2e03bc97 req-073827c1-b4e1-4ccb-a724-3703e8ccd440 service nova] Creating event network-changed:9b9a006a-5edb-47a3-8eaf-9ce87c8cab27 for instance 082cef74-9509-4b17-8250-cd6527a6e3eb on hv-cinder-84980 Jul 21 10:50:36.021787 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [req-2ea5076c-8710-45b8-a590-031b2e03bc97 req-073827c1-b4e1-4ccb-a724-3703e8ccd440 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029830 Jul 21 10:50:36.022375 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 287/591] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 21 10:50:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:50:36.032205 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-8e674d6f-a92d-47ba-b512-21eec22d2c4f tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:36.032205 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-8e674d6f-a92d-47ba-b512-21eec22d2c4f tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4ae0271efe4b4e9592b29d9f124519b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eff05785bd84522ad637d8bed14563d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:36.032671 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-8e674d6f-a92d-47ba-b512-21eec22d2c4f tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Searching by: {'deleted': False, 'project_id': '2eff05785bd84522ad637d8bed14563d'} {{(pid=124868) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 21 10:50:36.039452 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8e674d6f-a92d-47ba-b512-21eec22d2c4f tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:36.039887 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8e674d6f-a92d-47ba-b512-21eec22d2c4f tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:36.040663 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8e674d6f-a92d-47ba-b512-21eec22d2c4f tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:36.041088 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8e674d6f-a92d-47ba-b512-21eec22d2c4f tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:36.132451 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.multi_cell_list [None req-8e674d6f-a92d-47ba-b512-21eec22d2c4f tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124868) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 21 10:50:36.236094 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-e45eb3ae-36fb-4367-b8b8-d26f6b3ff6bd tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:36.238322 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-8e674d6f-a92d-47ba-b512-21eec22d2c4f tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] 10.222.0.48 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.214745 Jul 21 10:50:36.239095 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 288/592] 10.222.0.48 () {58 vars in 1124 bytes} [Thu Jul 21 10:50:36 2022] GET /compute/v2.1/servers => generated 343 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:50:36.244737 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-e45eb3ae-36fb-4367-b8b8-d26f6b3ff6bd tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb" status: 200 len: 1736 microversion: 2.1 time: 0.280229 Jul 21 10:50:36.251002 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 305/593] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:35 2022] GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb => generated 1736 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:50:36.254842 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-cf329e17-58d4-47e1-b7c6-e48f2e00839e tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:36.255651 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-cf329e17-58d4-47e1-b7c6-e48f2e00839e tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] [instance: 6597f555-38e1-4d14-bf7c-6d8b5e5a26d4] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:36.261774 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-cf329e17-58d4-47e1-b7c6-e48f2e00839e tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:36.262213 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-cf329e17-58d4-47e1-b7c6-e48f2e00839e tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:36.262993 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-cf329e17-58d4-47e1-b7c6-e48f2e00839e tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:36.263427 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-cf329e17-58d4-47e1-b7c6-e48f2e00839e tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:36.367471 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-be3bef62-62a3-4c09-b6a1-507d3a2dde09 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:36.368086 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-be3bef62-62a3-4c09-b6a1-507d3a2dde09 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 691ae8fc-92e7-4940-99d8-7edb5a96d2f3] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:36.374709 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-be3bef62-62a3-4c09-b6a1-507d3a2dde09 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:36.375160 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-be3bef62-62a3-4c09-b6a1-507d3a2dde09 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:36.375921 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-be3bef62-62a3-4c09-b6a1-507d3a2dde09 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:36.376354 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-be3bef62-62a3-4c09-b6a1-507d3a2dde09 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:36.490344 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-cf329e17-58d4-47e1-b7c6-e48f2e00839e tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0271efe4b4e9592b29d9f124519b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eff05785bd84522ad637d8bed14563d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:36.498492 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-cf329e17-58d4-47e1-b7c6-e48f2e00839e tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] 10.222.0.48 "GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4" status: 200 len: 1547 microversion: 2.1 time: 0.252664 Jul 21 10:50:36.499519 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 289/594] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:36 2022] GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4 => generated 1547 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:50:36.581346 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-be3bef62-62a3-4c09-b6a1-507d3a2dde09 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906e4bc4e9cc45ecb01cfca7918e461d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc215aadb5345d791945658832aae4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:36.592946 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-be3bef62-62a3-4c09-b6a1-507d3a2dde09 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/691ae8fc-92e7-4940-99d8-7edb5a96d2f3" status: 200 len: 1682 microversion: 2.1 time: 0.229310 Jul 21 10:50:36.593704 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 306/595] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:36 2022] GET /compute/v2.1/servers/691ae8fc-92e7-4940-99d8-7edb5a96d2f3 => generated 1682 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:50:37.008089 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-873b91f3-baef-43eb-b35d-0e8e0d484255 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:37.008692 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-873b91f3-baef-43eb-b35d-0e8e0d484255 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] [instance: 082cef74-9509-4b17-8250-cd6527a6e3eb] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:37.015350 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-873b91f3-baef-43eb-b35d-0e8e0d484255 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:37.015801 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-873b91f3-baef-43eb-b35d-0e8e0d484255 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:37.016552 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-873b91f3-baef-43eb-b35d-0e8e0d484255 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:37.017048 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-873b91f3-baef-43eb-b35d-0e8e0d484255 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:37.260487 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-873b91f3-baef-43eb-b35d-0e8e0d484255 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ccc2d61c7045a8abba95e7cd002a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24d5a2477eb74d5da5911b37f9031110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:37.262304 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-71395910-00b1-4d12-9374-df6aad687665 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:37.263307 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-71395910-00b1-4d12-9374-df6aad687665 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: a54643be-3f53-4fe5-bab0-786b71d627bb] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:37.269862 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-873b91f3-baef-43eb-b35d-0e8e0d484255 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] 10.222.0.48 "GET /compute/v2.1/servers/082cef74-9509-4b17-8250-cd6527a6e3eb" status: 200 len: 1319 microversion: 2.1 time: 0.266312 Jul 21 10:50:37.270734 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 290/596] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:37 2022] GET /compute/v2.1/servers/082cef74-9509-4b17-8250-cd6527a6e3eb => generated 1319 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:50:37.272402 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-71395910-00b1-4d12-9374-df6aad687665 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:37.272402 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-71395910-00b1-4d12-9374-df6aad687665 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:37.273157 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-71395910-00b1-4d12-9374-df6aad687665 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:37.273600 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-71395910-00b1-4d12-9374-df6aad687665 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:37.493473 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-71395910-00b1-4d12-9374-df6aad687665 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:37.495936 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell1:SELECT=100 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:50:37.503569 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-71395910-00b1-4d12-9374-df6aad687665 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb" status: 200 len: 1736 microversion: 2.1 time: 0.244803 Jul 21 10:50:37.504284 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 307/597] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:37 2022] GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb => generated 1736 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:50:37.614150 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-7ab5a3b9-9e73-4fe8-b69e-81fc22b5c934 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:37.615608 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-7ab5a3b9-9e73-4fe8-b69e-81fc22b5c934 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 691ae8fc-92e7-4940-99d8-7edb5a96d2f3] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:37.624233 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [req-4af5d621-0b68-415a-9c42-e89674ec3d2e req-183dd8ab-61e1-414d-897e-89cba433bb57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb24f843-eeb3-43dd-bd48-3bcf68e344cd", "tag": "2741d1f0-6bcb-4bee-8842-bc9bf8bc4db2"}]} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:50:37.639112 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-4af5d621-0b68-415a-9c42-e89674ec3d2e req-183dd8ab-61e1-414d-897e-89cba433bb57 service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:37.639685 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7ab5a3b9-9e73-4fe8-b69e-81fc22b5c934 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:37.640257 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7ab5a3b9-9e73-4fe8-b69e-81fc22b5c934 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:37.641196 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7ab5a3b9-9e73-4fe8-b69e-81fc22b5c934 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:37.641719 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7ab5a3b9-9e73-4fe8-b69e-81fc22b5c934 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:37.643157 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-4af5d621-0b68-415a-9c42-e89674ec3d2e req-183dd8ab-61e1-414d-897e-89cba433bb57 service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:37.671009 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.compute.server_external_events [req-4af5d621-0b68-415a-9c42-e89674ec3d2e req-183dd8ab-61e1-414d-897e-89cba433bb57 service nova] Creating event network-changed:2741d1f0-6bcb-4bee-8842-bc9bf8bc4db2 for instance eb24f843-eeb3-43dd-bd48-3bcf68e344cd on hv-cinder-84980 Jul 21 10:50:37.677797 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [req-4af5d621-0b68-415a-9c42-e89674ec3d2e req-183dd8ab-61e1-414d-897e-89cba433bb57 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057918 Jul 21 10:50:37.679155 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 308/598] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 21 10:50:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 10:50:37.907819 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-7ab5a3b9-9e73-4fe8-b69e-81fc22b5c934 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906e4bc4e9cc45ecb01cfca7918e461d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc215aadb5345d791945658832aae4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:37.917627 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-7ab5a3b9-9e73-4fe8-b69e-81fc22b5c934 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/691ae8fc-92e7-4940-99d8-7edb5a96d2f3" status: 200 len: 1682 microversion: 2.1 time: 0.307755 Jul 21 10:50:37.919077 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 291/599] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:37 2022] GET /compute/v2.1/servers/691ae8fc-92e7-4940-99d8-7edb5a96d2f3 => generated 1682 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:50:38.288092 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-2c9d77bf-5790-440b-8007-6fc7ca955132 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:38.289598 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-2c9d77bf-5790-440b-8007-6fc7ca955132 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] [instance: 082cef74-9509-4b17-8250-cd6527a6e3eb] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:38.297642 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2c9d77bf-5790-440b-8007-6fc7ca955132 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:38.298414 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2c9d77bf-5790-440b-8007-6fc7ca955132 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:38.299506 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2c9d77bf-5790-440b-8007-6fc7ca955132 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:38.300149 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2c9d77bf-5790-440b-8007-6fc7ca955132 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:38.457479 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [req-86e3acbb-7b68-49e2-af08-568105f28976 req-42f9b392-dbac-4aba-b3aa-fb4d0b8c7225 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "691ae8fc-92e7-4940-99d8-7edb5a96d2f3", "name": "network-vif-deleted", "tag": "d85d0196-f957-408d-bc00-26b64629a630"}]} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:50:38.470429 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-86e3acbb-7b68-49e2-af08-568105f28976 req-42f9b392-dbac-4aba-b3aa-fb4d0b8c7225 service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:38.470993 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-86e3acbb-7b68-49e2-af08-568105f28976 req-42f9b392-dbac-4aba-b3aa-fb4d0b8c7225 service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:38.471859 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-2c9d77bf-5790-440b-8007-6fc7ca955132 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ccc2d61c7045a8abba95e7cd002a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24d5a2477eb74d5da5911b37f9031110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:38.480422 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-2c9d77bf-5790-440b-8007-6fc7ca955132 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] 10.222.0.48 "GET /compute/v2.1/servers/082cef74-9509-4b17-8250-cd6527a6e3eb" status: 200 len: 1319 microversion: 2.1 time: 0.197070 Jul 21 10:50:38.480993 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 309/600] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:38 2022] GET /compute/v2.1/servers/082cef74-9509-4b17-8250-cd6527a6e3eb => generated 1319 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:50:38.484900 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.compute.server_external_events [req-86e3acbb-7b68-49e2-af08-568105f28976 req-42f9b392-dbac-4aba-b3aa-fb4d0b8c7225 service nova] Creating event network-vif-deleted:d85d0196-f957-408d-bc00-26b64629a630 for instance 691ae8fc-92e7-4940-99d8-7edb5a96d2f3 on hv-cinder-84980 Jul 21 10:50:38.488916 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-6b4cdfa3-1693-4f54-820a-0a804847fdac tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eae9be38-e38e-4e52-accb-d0ba35b74567"}} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:50:38.490311 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [req-86e3acbb-7b68-49e2-af08-568105f28976 req-42f9b392-dbac-4aba-b3aa-fb4d0b8c7225 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039521 Jul 21 10:50:38.490871 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-6b4cdfa3-1693-4f54-820a-0a804847fdac tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] [instance: 6597f555-38e1-4d14-bf7c-6d8b5e5a26d4] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:38.491414 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 292/601] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 21 10:50:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:50:38.493447 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell0:SELECT=2 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:50:38.499293 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6b4cdfa3-1693-4f54-820a-0a804847fdac tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:38.500116 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6b4cdfa3-1693-4f54-820a-0a804847fdac tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:38.500583 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6b4cdfa3-1693-4f54-820a-0a804847fdac tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:38.501020 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6b4cdfa3-1693-4f54-820a-0a804847fdac tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:38.528321 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-05e997db-6c23-4a4d-a94e-82434edf5882 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:38.529925 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-05e997db-6c23-4a4d-a94e-82434edf5882 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: a54643be-3f53-4fe5-bab0-786b71d627bb] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:38.538167 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-05e997db-6c23-4a4d-a94e-82434edf5882 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:38.539497 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-05e997db-6c23-4a4d-a94e-82434edf5882 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:38.539771 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-05e997db-6c23-4a4d-a94e-82434edf5882 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:38.540379 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-05e997db-6c23-4a4d-a94e-82434edf5882 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:38.713465 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-05e997db-6c23-4a4d-a94e-82434edf5882 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:38.723270 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-05e997db-6c23-4a4d-a94e-82434edf5882 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb" status: 200 len: 1736 microversion: 2.1 time: 0.204405 Jul 21 10:50:38.724088 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 293/602] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:38 2022] GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb => generated 1736 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:50:38.826754 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell0:SELECT=8 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:50:38.936433 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-f09a7bf9-2548-46ee-81f0-795d60440055 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:38.937047 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-f09a7bf9-2548-46ee-81f0-795d60440055 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 691ae8fc-92e7-4940-99d8-7edb5a96d2f3] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:38.943029 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f09a7bf9-2548-46ee-81f0-795d60440055 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:38.943478 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f09a7bf9-2548-46ee-81f0-795d60440055 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:38.944235 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f09a7bf9-2548-46ee-81f0-795d60440055 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:38.944673 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f09a7bf9-2548-46ee-81f0-795d60440055 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:39.008171 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-f09a7bf9-2548-46ee-81f0-795d60440055 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906e4bc4e9cc45ecb01cfca7918e461d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc215aadb5345d791945658832aae4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:39.017073 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-f09a7bf9-2548-46ee-81f0-795d60440055 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/691ae8fc-92e7-4940-99d8-7edb5a96d2f3" status: 200 len: 1615 microversion: 2.1 time: 0.084629 Jul 21 10:50:39.017641 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 294/603] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:38 2022] GET /compute/v2.1/servers/691ae8fc-92e7-4940-99d8-7edb5a96d2f3 => generated 1615 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:50:39.500278 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-0dababc8-7c04-4c3e-8523-1e30f543ce0d tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:39.501761 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-0dababc8-7c04-4c3e-8523-1e30f543ce0d tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] [instance: 082cef74-9509-4b17-8250-cd6527a6e3eb] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:39.516006 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0dababc8-7c04-4c3e-8523-1e30f543ce0d tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:39.516734 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0dababc8-7c04-4c3e-8523-1e30f543ce0d tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:39.517500 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0dababc8-7c04-4c3e-8523-1e30f543ce0d tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:39.518855 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0dababc8-7c04-4c3e-8523-1e30f543ce0d tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:39.726108 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-0dababc8-7c04-4c3e-8523-1e30f543ce0d tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ccc2d61c7045a8abba95e7cd002a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24d5a2477eb74d5da5911b37f9031110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:39.743039 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-0dababc8-7c04-4c3e-8523-1e30f543ce0d tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] 10.222.0.48 "GET /compute/v2.1/servers/082cef74-9509-4b17-8250-cd6527a6e3eb" status: 200 len: 1319 microversion: 2.1 time: 0.247636 Jul 21 10:50:39.745245 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 295/604] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:39 2022] GET /compute/v2.1/servers/082cef74-9509-4b17-8250-cd6527a6e3eb => generated 1319 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:50:39.756091 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-7341d848-96b6-4155-9f3d-208bbdf6da63 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:39.756983 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-7341d848-96b6-4155-9f3d-208bbdf6da63 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: a54643be-3f53-4fe5-bab0-786b71d627bb] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:39.764528 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7341d848-96b6-4155-9f3d-208bbdf6da63 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:39.764661 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7341d848-96b6-4155-9f3d-208bbdf6da63 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:39.765402 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7341d848-96b6-4155-9f3d-208bbdf6da63 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:39.765847 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7341d848-96b6-4155-9f3d-208bbdf6da63 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:39.923996 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-7341d848-96b6-4155-9f3d-208bbdf6da63 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:39.933704 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-7341d848-96b6-4155-9f3d-208bbdf6da63 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb" status: 200 len: 1736 microversion: 2.1 time: 0.187022 Jul 21 10:50:39.934319 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 296/605] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:39 2022] GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb => generated 1736 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:50:40.032508 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-6b4cdfa3-1693-4f54-820a-0a804847fdac tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] 10.222.0.48 "POST /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.547993 Jul 21 10:50:40.033218 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 310/606] 10.222.0.48 () {60 vars in 1322 bytes} [Thu Jul 21 10:50:38 2022] POST /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4/os-volume_attachments => generated 194 bytes in 1551 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:50:40.034556 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-53a82233-cddf-4f68-8698-b72952bcf3b9 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:40.035385 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-53a82233-cddf-4f68-8698-b72952bcf3b9 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 691ae8fc-92e7-4940-99d8-7edb5a96d2f3] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:40.043601 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-53a82233-cddf-4f68-8698-b72952bcf3b9 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:40.043601 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-53a82233-cddf-4f68-8698-b72952bcf3b9 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:40.043601 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-53a82233-cddf-4f68-8698-b72952bcf3b9 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:40.043601 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-53a82233-cddf-4f68-8698-b72952bcf3b9 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:40.077666 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-53a82233-cddf-4f68-8698-b72952bcf3b9 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:40.078162 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-53a82233-cddf-4f68-8698-b72952bcf3b9 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:40.078643 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.objects.instance [None req-53a82233-cddf-4f68-8698-b72952bcf3b9 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lazy-loading 'fault' on Instance uuid 691ae8fc-92e7-4940-99d8-7edb5a96d2f3 {{(pid=124868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 10:50:40.137578 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-53a82233-cddf-4f68-8698-b72952bcf3b9 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906e4bc4e9cc45ecb01cfca7918e461d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc215aadb5345d791945658832aae4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:40.147564 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-53a82233-cddf-4f68-8698-b72952bcf3b9 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/691ae8fc-92e7-4940-99d8-7edb5a96d2f3" status: 200 len: 1332 microversion: 2.1 time: 0.117898 Jul 21 10:50:40.148067 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 297/607] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:40 2022] GET /compute/v2.1/servers/691ae8fc-92e7-4940-99d8-7edb5a96d2f3 => generated 1332 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:50:40.765131 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-d3d40543-2a8f-45b3-a46f-6ab0bd8fc2ce tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:40.765820 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-d3d40543-2a8f-45b3-a46f-6ab0bd8fc2ce tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] [instance: 082cef74-9509-4b17-8250-cd6527a6e3eb] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:40.772152 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d3d40543-2a8f-45b3-a46f-6ab0bd8fc2ce tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:40.772596 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d3d40543-2a8f-45b3-a46f-6ab0bd8fc2ce tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:40.773340 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d3d40543-2a8f-45b3-a46f-6ab0bd8fc2ce tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:40.773768 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d3d40543-2a8f-45b3-a46f-6ab0bd8fc2ce tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:40.908449 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-d3d40543-2a8f-45b3-a46f-6ab0bd8fc2ce tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ccc2d61c7045a8abba95e7cd002a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24d5a2477eb74d5da5911b37f9031110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:40.915793 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-d3d40543-2a8f-45b3-a46f-6ab0bd8fc2ce tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] 10.222.0.48 "GET /compute/v2.1/servers/082cef74-9509-4b17-8250-cd6527a6e3eb" status: 200 len: 1319 microversion: 2.1 time: 0.156119 Jul 21 10:50:40.923038 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 311/608] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:40 2022] GET /compute/v2.1/servers/082cef74-9509-4b17-8250-cd6527a6e3eb => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:50:40.953967 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-8652b7f4-ab2a-4805-8354-f3ecae26de23 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:40.954638 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-8652b7f4-ab2a-4805-8354-f3ecae26de23 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: a54643be-3f53-4fe5-bab0-786b71d627bb] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:40.961119 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8652b7f4-ab2a-4805-8354-f3ecae26de23 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:40.961589 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8652b7f4-ab2a-4805-8354-f3ecae26de23 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:40.962353 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8652b7f4-ab2a-4805-8354-f3ecae26de23 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:40.962814 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8652b7f4-ab2a-4805-8354-f3ecae26de23 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:41.099395 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-8652b7f4-ab2a-4805-8354-f3ecae26de23 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:41.108733 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-8652b7f4-ab2a-4805-8354-f3ecae26de23 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb" status: 200 len: 1736 microversion: 2.1 time: 0.158627 Jul 21 10:50:41.109312 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 298/609] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:40 2022] GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:50:41.168520 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-22e7787f-20b2-405c-a15d-b237cd5ac1b8 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:41.169145 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-22e7787f-20b2-405c-a15d-b237cd5ac1b8 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 691ae8fc-92e7-4940-99d8-7edb5a96d2f3] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:41.175283 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-22e7787f-20b2-405c-a15d-b237cd5ac1b8 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:41.175724 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-22e7787f-20b2-405c-a15d-b237cd5ac1b8 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:41.176476 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-22e7787f-20b2-405c-a15d-b237cd5ac1b8 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:41.176905 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-22e7787f-20b2-405c-a15d-b237cd5ac1b8 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:41.190572 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.wsgi [None req-22e7787f-20b2-405c-a15d-b237cd5ac1b8 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] HTTP exception thrown: Instance 691ae8fc-92e7-4940-99d8-7edb5a96d2f3 could not be found. Jul 21 10:50:41.192184 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-22e7787f-20b2-405c-a15d-b237cd5ac1b8 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Request method failure captured: Jul 21 10:50:41.192184 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: request: GET /compute/v2.1/servers/691ae8fc-92e7-4940-99d8-7edb5a96d2f3 HTTP/1.1 Jul 21 10:50:41.192184 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Accept: application/json Jul 21 10:50:41.192184 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Accept-Encoding: identity Jul 21 10:50:41.192184 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Connection: close Jul 21 10:50:41.192184 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Content-Length: 0 Jul 21 10:50:41.192184 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Content-Type: application/json Jul 21 10:50:41.192184 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Host: 10.222.0.48 Jul 21 10:50:41.192184 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Openstack-System-Scope: None Jul 21 10:50:41.192184 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: User-Agent: python-urllib3/1.26.9 Jul 21 10:50:41.192184 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Auth-Token: gAAAAABi2S6IjD13fpvyB3gT_wfBhrxBWJW9IyP2Nfh-tKREma2qJlItcJifOI1FikOPoU86kC4jMPIUJv7c1XQEgHyn13RPV4dm8YXLpWP83NoB7MDue-0ef8jz1-9ETLoC72jgbX7x_bNoV_fia9kSfgVPDrqxya-pNvknwmV6TjdQwJPLki8 Jul 21 10:50:41.192184 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Domain-Id: None Jul 21 10:50:41.192184 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Domain-Name: None Jul 21 10:50:41.192184 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Identity-Status: Confirmed Jul 21 10:50:41.192184 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Is-Admin-Project: True Jul 21 10:50:41.192184 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Project-Domain-Id: default Jul 21 10:50:41.192184 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Project-Domain-Name: Default Jul 21 10:50:41.192184 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Project-Id: 0dc215aadb5345d791945658832aae4a Jul 21 10:50:41.192184 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Project-Name: tempest-AttachVolumeNegativeTest-692763952 Jul 21 10:50:41.192184 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Role: reader,member Jul 21 10:50:41.192184 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Roles: reader,member Jul 21 10:50:41.193782 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0dc215aadb5345d791945658832aae4a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0dc215aadb5345d791945658832aae4a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0dc215aadb5345d791945658832aae4a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0dc215aadb5345d791945658832aae4a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] Jul 21 10:50:41.193782 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Tenant: tempest-AttachVolumeNegativeTest-692763952 Jul 21 10:50:41.193782 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Tenant-Id: 0dc215aadb5345d791945658832aae4a Jul 21 10:50:41.193782 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-692763952 Jul 21 10:50:41.193782 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User: tempest-AttachVolumeNegativeTest-692763952-project Jul 21 10:50:41.193782 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User-Domain-Id: default Jul 21 10:50:41.193782 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User-Domain-Name: Default Jul 21 10:50:41.193782 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User-Id: 906e4bc4e9cc45ecb01cfca7918e461d Jul 21 10:50:41.193782 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User-Name: tempest-AttachVolumeNegativeTest-692763952-project Jul 21 10:50:41.193782 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: method: > Jul 21 10:50:41.193782 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: exception: Instance 691ae8fc-92e7-4940-99d8-7edb5a96d2f3 could not be found. Jul 21 10:50:41.193782 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: action_args: {'id': '691ae8fc-92e7-4940-99d8-7edb5a96d2f3'} Jul 21 10:50:41.194619 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 10:50:41.194619 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:50:41.194619 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 10:50:41.194619 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 10:50:41.194619 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 10:50:41.194619 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 10:50:41.194619 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 10:50:41.194619 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 10:50:41.194619 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 10:50:41.194619 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 10:50:41.194619 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 691ae8fc-92e7-4940-99d8-7edb5a96d2f3 could not be found. Jul 21 10:50:41.194619 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:50:41.194619 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:50:41.194619 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:50:41.194619 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:50:41.194619 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:50:41.194619 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:50:41.194619 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 10:50:41.194619 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 10:50:41.194619 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 10:50:41.195986 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 10:50:41.195986 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 10:50:41.195986 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 10:50:41.195986 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 10:50:41.195986 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 10:50:41.195986 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 10:50:41.195986 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 10:50:41.195986 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 691ae8fc-92e7-4940-99d8-7edb5a96d2f3 could not be found. Jul 21 10:50:41.195986 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:50:41.195986 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:50:41.195986 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:50:41.195986 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:50:41.195986 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:50:41.195986 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:50:41.195986 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 10:50:41.195986 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 10:50:41.195986 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 691ae8fc-92e7-4940-99d8-7edb5a96d2f3 could not be found. Jul 21 10:50:41.195986 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:50:41.197256 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-22e7787f-20b2-405c-a15d-b237cd5ac1b8 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Returning 404 to user: Instance 691ae8fc-92e7-4940-99d8-7edb5a96d2f3 could not be found. {{(pid=124867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 10:50:41.197256 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-22e7787f-20b2-405c-a15d-b237cd5ac1b8 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/691ae8fc-92e7-4940-99d8-7edb5a96d2f3" status: 404 len: 111 microversion: 2.1 time: 0.028939 Jul 21 10:50:41.197256 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 312/610] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:41 2022] GET /compute/v2.1/servers/691ae8fc-92e7-4940-99d8-7edb5a96d2f3 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 10:50:41.203883 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-741d4fb8-bd1c-4143-9f62-14f1d5d1ee64 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '.version_select at 0x7f7962b6d5e0>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:41.279578 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-741d4fb8-bd1c-4143-9f62-14f1d5d1ee64 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2047653555" status: 202 len: 0 microversion: 2.1 time: 0.080562 Jul 21 10:50:41.280234 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 299/611] 10.222.0.48 () {58 vars in 1220 bytes} [Thu Jul 21 10:50:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2047653555 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 10:50:41.789217 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [req-d55ec17c-316b-47db-8794-5fb8244a1c2b req-fe55f9f4-b7e7-4769-8f38-cedf5a749004 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "082cef74-9509-4b17-8250-cd6527a6e3eb", "name": "network-vif-plugged", "status": "completed", "tag": "9b9a006a-5edb-47a3-8eaf-9ce87c8cab27"}]} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:50:41.798885 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-d55ec17c-316b-47db-8794-5fb8244a1c2b req-fe55f9f4-b7e7-4769-8f38-cedf5a749004 service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:41.799403 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-d55ec17c-316b-47db-8794-5fb8244a1c2b req-fe55f9f4-b7e7-4769-8f38-cedf5a749004 service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:41.812754 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.compute.server_external_events [req-d55ec17c-316b-47db-8794-5fb8244a1c2b req-fe55f9f4-b7e7-4769-8f38-cedf5a749004 service nova] Creating event network-vif-plugged:9b9a006a-5edb-47a3-8eaf-9ce87c8cab27 for instance 082cef74-9509-4b17-8250-cd6527a6e3eb on hv-cinder-84980 Jul 21 10:50:41.817684 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [req-d55ec17c-316b-47db-8794-5fb8244a1c2b req-fe55f9f4-b7e7-4769-8f38-cedf5a749004 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032196 Jul 21 10:50:41.818271 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 313/612] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 21 10:50:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 10:50:41.938177 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-9cec69e2-0523-48fd-a8f1-ec6efb34bad4 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:41.939135 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-9cec69e2-0523-48fd-a8f1-ec6efb34bad4 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] [instance: 082cef74-9509-4b17-8250-cd6527a6e3eb] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:41.947190 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9cec69e2-0523-48fd-a8f1-ec6efb34bad4 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:41.951401 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9cec69e2-0523-48fd-a8f1-ec6efb34bad4 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:41.951401 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9cec69e2-0523-48fd-a8f1-ec6efb34bad4 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:41.951401 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9cec69e2-0523-48fd-a8f1-ec6efb34bad4 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:42.090751 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-c6407f51-102f-4c78-bdb3-66a4162374bd tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Action: 'create', calling method: .version_select at 0x7f795ecec940>, body: {"keypair": {"name": "tempest-keypair-1959860331", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBHJjV952MjmKxvuNiE1f1xNkQFygrvwltund1iFRzBqCjQsq57dsy3n+Ly9EpGM4Igfg0ViCF//We6TAbrDLp0AplzcextC21fFOanrTeqonhB7tD0hmaaatdMa5jXqmw=="}} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:50:42.107446 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.quota [None req-c6407f51-102f-4c78-bdb3-66a4162374bd tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Getting quotas for project 0dc215aadb5345d791945658832aae4a. Resources: {'key_pairs'} {{(pid=124867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 10:50:42.112022 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.quota [None req-c6407f51-102f-4c78-bdb3-66a4162374bd tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Getting quotas for user 906e4bc4e9cc45ecb01cfca7918e461d and project 0dc215aadb5345d791945658832aae4a. Resources: {'key_pairs'} {{(pid=124867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 10:50:42.119714 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-9cec69e2-0523-48fd-a8f1-ec6efb34bad4 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ccc2d61c7045a8abba95e7cd002a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24d5a2477eb74d5da5911b37f9031110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:42.128778 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-9cec69e2-0523-48fd-a8f1-ec6efb34bad4 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] 10.222.0.48 "GET /compute/v2.1/servers/082cef74-9509-4b17-8250-cd6527a6e3eb" status: 200 len: 1319 microversion: 2.1 time: 0.198045 Jul 21 10:50:42.129357 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 300/613] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:41 2022] GET /compute/v2.1/servers/082cef74-9509-4b17-8250-cd6527a6e3eb => generated 1319 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:50:42.135251 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-b82364f1-5192-43d8-a016-fa0ea4f827ad tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:42.135853 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-b82364f1-5192-43d8-a016-fa0ea4f827ad tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: a54643be-3f53-4fe5-bab0-786b71d627bb] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:42.142592 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b82364f1-5192-43d8-a016-fa0ea4f827ad tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:42.143082 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b82364f1-5192-43d8-a016-fa0ea4f827ad tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:42.143851 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b82364f1-5192-43d8-a016-fa0ea4f827ad tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:42.144285 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b82364f1-5192-43d8-a016-fa0ea4f827ad tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:42.223390 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-c6407f51-102f-4c78-bdb3-66a4162374bd tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.137692 Jul 21 10:50:42.226574 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 314/614] 10.222.0.48 () {60 vars in 1158 bytes} [Thu Jul 21 10:50:42 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:50:42.323888 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-b82364f1-5192-43d8-a016-fa0ea4f827ad tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:42.332204 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-b82364f1-5192-43d8-a016-fa0ea4f827ad tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb" status: 200 len: 1736 microversion: 2.1 time: 0.201475 Jul 21 10:50:42.333096 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 301/615] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:42 2022] GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb => generated 1736 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:50:43.146443 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-c0ea30fc-9820-4086-913c-7eec2c54332f tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:43.148219 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-c0ea30fc-9820-4086-913c-7eec2c54332f tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] [instance: 082cef74-9509-4b17-8250-cd6527a6e3eb] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:43.155069 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c0ea30fc-9820-4086-913c-7eec2c54332f tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:43.155495 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c0ea30fc-9820-4086-913c-7eec2c54332f tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:43.157109 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c0ea30fc-9820-4086-913c-7eec2c54332f tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:43.157638 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c0ea30fc-9820-4086-913c-7eec2c54332f tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:43.305151 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-c0ea30fc-9820-4086-913c-7eec2c54332f tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ccc2d61c7045a8abba95e7cd002a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24d5a2477eb74d5da5911b37f9031110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:43.313039 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-c0ea30fc-9820-4086-913c-7eec2c54332f tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] 10.222.0.48 "GET /compute/v2.1/servers/082cef74-9509-4b17-8250-cd6527a6e3eb" status: 200 len: 1319 microversion: 2.1 time: 0.170524 Jul 21 10:50:43.313609 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 315/616] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:43 2022] GET /compute/v2.1/servers/082cef74-9509-4b17-8250-cd6527a6e3eb => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:50:43.349360 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-17164858-4172-49ad-9655-cd8f6ada22a9 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:43.349914 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-17164858-4172-49ad-9655-cd8f6ada22a9 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: a54643be-3f53-4fe5-bab0-786b71d627bb] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:43.356636 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-17164858-4172-49ad-9655-cd8f6ada22a9 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:43.357084 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-17164858-4172-49ad-9655-cd8f6ada22a9 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:43.358039 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-17164858-4172-49ad-9655-cd8f6ada22a9 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:43.358475 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-17164858-4172-49ad-9655-cd8f6ada22a9 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:43.501967 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-17164858-4172-49ad-9655-cd8f6ada22a9 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:43.510330 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-17164858-4172-49ad-9655-cd8f6ada22a9 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb" status: 200 len: 1736 microversion: 2.1 time: 0.164813 Jul 21 10:50:43.510960 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 302/617] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:43 2022] GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:50:44.330273 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-93b9f5c2-f41c-44e3-80ec-3d368e9e2fa6 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:44.331859 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-93b9f5c2-f41c-44e3-80ec-3d368e9e2fa6 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] [instance: 082cef74-9509-4b17-8250-cd6527a6e3eb] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:44.339249 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-93b9f5c2-f41c-44e3-80ec-3d368e9e2fa6 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:44.339774 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-93b9f5c2-f41c-44e3-80ec-3d368e9e2fa6 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:44.340579 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-93b9f5c2-f41c-44e3-80ec-3d368e9e2fa6 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:44.341096 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-93b9f5c2-f41c-44e3-80ec-3d368e9e2fa6 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:44.479234 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-93b9f5c2-f41c-44e3-80ec-3d368e9e2fa6 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ccc2d61c7045a8abba95e7cd002a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24d5a2477eb74d5da5911b37f9031110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:44.487773 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-93b9f5c2-f41c-44e3-80ec-3d368e9e2fa6 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] 10.222.0.48 "GET /compute/v2.1/servers/082cef74-9509-4b17-8250-cd6527a6e3eb" status: 200 len: 1509 microversion: 2.1 time: 0.161987 Jul 21 10:50:44.488342 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 316/618] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:44 2022] GET /compute/v2.1/servers/082cef74-9509-4b17-8250-cd6527a6e3eb => generated 1509 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:50:44.510702 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-f19653e7-1730-4873-948a-a3812fd36ae4 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f63ea6d4-a5f4-429b-b394-9ce173ccab32", "device": "/dev/sdb"}} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:50:44.511808 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-f19653e7-1730-4873-948a-a3812fd36ae4 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] [instance: 082cef74-9509-4b17-8250-cd6527a6e3eb] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:44.514286 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:50:44.519146 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f19653e7-1730-4873-948a-a3812fd36ae4 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:44.519597 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f19653e7-1730-4873-948a-a3812fd36ae4 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:44.520368 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f19653e7-1730-4873-948a-a3812fd36ae4 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:44.520802 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f19653e7-1730-4873-948a-a3812fd36ae4 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:44.528887 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-fd3458dd-7548-4ebc-a4ef-26e8b988284b tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:44.545127 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-fd3458dd-7548-4ebc-a4ef-26e8b988284b tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: a54643be-3f53-4fe5-bab0-786b71d627bb] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:44.545292 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell1:SELECT=100 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:50:44.545403 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fd3458dd-7548-4ebc-a4ef-26e8b988284b tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:44.545403 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fd3458dd-7548-4ebc-a4ef-26e8b988284b tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:44.545403 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fd3458dd-7548-4ebc-a4ef-26e8b988284b tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:44.545403 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fd3458dd-7548-4ebc-a4ef-26e8b988284b tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:44.681877 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-fd3458dd-7548-4ebc-a4ef-26e8b988284b tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:44.690174 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-fd3458dd-7548-4ebc-a4ef-26e8b988284b tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb" status: 200 len: 1736 microversion: 2.1 time: 0.165539 Jul 21 10:50:44.690779 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 317/619] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:44 2022] GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb => generated 1736 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:50:44.736239 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-a86e7056-5c90-43cc-a38f-394bf0194a89 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-814194112", "imageRef": "282ddb30-fa0f-489d-9cc3-a3e70e03c631", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "192d6a0f-c1f8-471a-872f-e924c6d8f479"}], "security_groups": [{"name": "tempest-securitygroup--338649749"}], "key_name": "tempest-keypair-1959860331", "user_data": "}} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:50:44.846041 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.network.neutron [None req-a86e7056-5c90-43cc-a38f-394bf0194a89 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] validate_networks() for [('192d6a0f-c1f8-471a-872f-e924c6d8f479', None, None, None, None, None)] {{(pid=124867) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 10:50:45.217148 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-a86e7056-5c90-43cc-a38f-394bf0194a89 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Flavor limits 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 10:50:45.217598 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-a86e7056-5c90-43cc-a38f-394bf0194a89 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Image limits 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 10:50:45.218071 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-a86e7056-5c90-43cc-a38f-394bf0194a89 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Flavor pref 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 10:50:45.218498 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-a86e7056-5c90-43cc-a38f-394bf0194a89 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Image pref 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 10:50:45.219689 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-a86e7056-5c90-43cc-a38f-394bf0194a89 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 10:50:45.228267 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a86e7056-5c90-43cc-a38f-394bf0194a89 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:45.228705 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a86e7056-5c90-43cc-a38f-394bf0194a89 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:45.229487 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a86e7056-5c90-43cc-a38f-394bf0194a89 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:45.230011 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a86e7056-5c90-43cc-a38f-394bf0194a89 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:45.246561 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.quota [None req-a86e7056-5c90-43cc-a38f-394bf0194a89 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Getting quotas for project 0dc215aadb5345d791945658832aae4a. Resources: {'ram', 'instances', 'cores'} {{(pid=124867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 10:50:45.250655 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.quota [None req-a86e7056-5c90-43cc-a38f-394bf0194a89 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Getting quotas for user 906e4bc4e9cc45ecb01cfca7918e461d and project 0dc215aadb5345d791945658832aae4a. Resources: {'ram', 'instances', 'cores'} {{(pid=124867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 10:50:45.261636 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-a86e7056-5c90-43cc-a38f-394bf0194a89 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Going to run 1 instances... {{(pid=124867) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 10:50:45.263922 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-a86e7056-5c90-43cc-a38f-394bf0194a89 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 6803db4b-7556-4e4e-989c-adfa3d140a09] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='282ddb30-fa0f-489d-9cc3-a3e70e03c631',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124867) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 10:50:45.527239 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-a86e7056-5c90-43cc-a38f-394bf0194a89 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.795779 Jul 21 10:50:45.527919 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 318/620] 10.222.0.48 () {60 vars in 1146 bytes} [Thu Jul 21 10:50:44 2022] POST /compute/v2.1/servers => generated 401 bytes in 797 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 21 10:50:45.537718 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-ab857a13-52e6-4b2d-8e78-0824743d46e2 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:45.538322 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-ab857a13-52e6-4b2d-8e78-0824743d46e2 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 6803db4b-7556-4e4e-989c-adfa3d140a09] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:45.595049 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-f19653e7-1730-4873-948a-a3812fd36ae4 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] 10.222.0.48 "POST /compute/v2.1/servers/082cef74-9509-4b17-8250-cd6527a6e3eb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.087291 Jul 21 10:50:45.598216 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 303/621] 10.222.0.48 () {60 vars in 1322 bytes} [Thu Jul 21 10:50:44 2022] POST /compute/v2.1/servers/082cef74-9509-4b17-8250-cd6527a6e3eb/os-volume_attachments => generated 194 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:50:45.599006 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-ab857a13-52e6-4b2d-8e78-0824743d46e2 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906e4bc4e9cc45ecb01cfca7918e461d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc215aadb5345d791945658832aae4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:45.608062 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-ab857a13-52e6-4b2d-8e78-0824743d46e2 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/6803db4b-7556-4e4e-989c-adfa3d140a09" status: 200 len: 1241 microversion: 2.1 time: 0.073919 Jul 21 10:50:45.608998 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 319/622] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:45 2022] GET /compute/v2.1/servers/6803db4b-7556-4e4e-989c-adfa3d140a09 => generated 1241 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:50:45.708553 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-e553156d-9c8b-434c-a76c-33c8bc34dcb6 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:45.709363 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-e553156d-9c8b-434c-a76c-33c8bc34dcb6 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: a54643be-3f53-4fe5-bab0-786b71d627bb] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:45.717779 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e553156d-9c8b-434c-a76c-33c8bc34dcb6 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:45.718335 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e553156d-9c8b-434c-a76c-33c8bc34dcb6 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:45.719361 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e553156d-9c8b-434c-a76c-33c8bc34dcb6 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:45.719753 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e553156d-9c8b-434c-a76c-33c8bc34dcb6 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:45.858168 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-e553156d-9c8b-434c-a76c-33c8bc34dcb6 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:45.866887 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-e553156d-9c8b-434c-a76c-33c8bc34dcb6 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb" status: 200 len: 1736 microversion: 2.1 time: 0.163161 Jul 21 10:50:45.870476 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 304/623] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:45 2022] GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:50:46.626121 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-b996a8f5-2403-4d55-8b75-a8f1804907eb tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:46.626759 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-b996a8f5-2403-4d55-8b75-a8f1804907eb tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 6803db4b-7556-4e4e-989c-adfa3d140a09] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:46.633403 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b996a8f5-2403-4d55-8b75-a8f1804907eb tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:46.633874 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b996a8f5-2403-4d55-8b75-a8f1804907eb tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:46.634649 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b996a8f5-2403-4d55-8b75-a8f1804907eb tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:46.635099 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b996a8f5-2403-4d55-8b75-a8f1804907eb tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:46.695889 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-b996a8f5-2403-4d55-8b75-a8f1804907eb tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906e4bc4e9cc45ecb01cfca7918e461d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc215aadb5345d791945658832aae4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:46.703432 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-b996a8f5-2403-4d55-8b75-a8f1804907eb tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/6803db4b-7556-4e4e-989c-adfa3d140a09" status: 200 len: 1245 microversion: 2.1 time: 0.081668 Jul 21 10:50:46.704054 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 320/624] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:46 2022] GET /compute/v2.1/servers/6803db4b-7556-4e4e-989c-adfa3d140a09 => generated 1245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:50:46.885518 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-c98c3450-fb9d-4033-b71f-6a35e7567ad5 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:46.886133 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-c98c3450-fb9d-4033-b71f-6a35e7567ad5 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: a54643be-3f53-4fe5-bab0-786b71d627bb] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:46.888196 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell0:SELECT=2 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:50:46.894136 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c98c3450-fb9d-4033-b71f-6a35e7567ad5 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:46.894605 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c98c3450-fb9d-4033-b71f-6a35e7567ad5 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:46.895376 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c98c3450-fb9d-4033-b71f-6a35e7567ad5 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:46.895827 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c98c3450-fb9d-4033-b71f-6a35e7567ad5 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:47.028725 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-c98c3450-fb9d-4033-b71f-6a35e7567ad5 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:47.037032 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-c98c3450-fb9d-4033-b71f-6a35e7567ad5 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb" status: 200 len: 1736 microversion: 2.1 time: 0.155499 Jul 21 10:50:47.037594 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 305/625] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:46 2022] GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:50:47.721676 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-b8a36c49-dbfb-449c-bc72-2a7ef918b68e tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:47.723016 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-b8a36c49-dbfb-449c-bc72-2a7ef918b68e tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 6803db4b-7556-4e4e-989c-adfa3d140a09] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:47.735584 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b8a36c49-dbfb-449c-bc72-2a7ef918b68e tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:47.735584 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b8a36c49-dbfb-449c-bc72-2a7ef918b68e tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:47.735584 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b8a36c49-dbfb-449c-bc72-2a7ef918b68e tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:47.735584 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b8a36c49-dbfb-449c-bc72-2a7ef918b68e tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:47.800634 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-b8a36c49-dbfb-449c-bc72-2a7ef918b68e tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906e4bc4e9cc45ecb01cfca7918e461d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc215aadb5345d791945658832aae4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:47.808428 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-b8a36c49-dbfb-449c-bc72-2a7ef918b68e tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/6803db4b-7556-4e4e-989c-adfa3d140a09" status: 200 len: 1293 microversion: 2.1 time: 0.091986 Jul 21 10:50:47.809007 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 321/626] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:47 2022] GET /compute/v2.1/servers/6803db4b-7556-4e4e-989c-adfa3d140a09 => generated 1293 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:50:48.054224 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-f397cf5c-b885-4f31-b175-0881c0e000fa tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:48.054792 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-f397cf5c-b885-4f31-b175-0881c0e000fa tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: a54643be-3f53-4fe5-bab0-786b71d627bb] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:48.061345 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f397cf5c-b885-4f31-b175-0881c0e000fa tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:48.061795 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f397cf5c-b885-4f31-b175-0881c0e000fa tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:48.063246 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f397cf5c-b885-4f31-b175-0881c0e000fa tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:48.063823 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f397cf5c-b885-4f31-b175-0881c0e000fa tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:48.197728 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-f397cf5c-b885-4f31-b175-0881c0e000fa tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:48.201608 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-f397cf5c-b885-4f31-b175-0881c0e000fa tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb" status: 200 len: 1736 microversion: 2.1 time: 0.151218 Jul 21 10:50:48.202254 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 306/627] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:48 2022] GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:50:48.672308 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-992acd45-d0ef-40f7-a49d-6046e2156185 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:48.674463 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-992acd45-d0ef-40f7-a49d-6046e2156185 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] [instance: 6597f555-38e1-4d14-bf7c-6d8b5e5a26d4] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:48.679435 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-992acd45-d0ef-40f7-a49d-6046e2156185 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:48.679878 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-992acd45-d0ef-40f7-a49d-6046e2156185 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:48.680630 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-992acd45-d0ef-40f7-a49d-6046e2156185 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:48.681062 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-992acd45-d0ef-40f7-a49d-6046e2156185 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:48.821237 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-992acd45-d0ef-40f7-a49d-6046e2156185 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0271efe4b4e9592b29d9f124519b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eff05785bd84522ad637d8bed14563d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:48.830109 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-3c4a1df3-1634-40ea-9fbc-cf930888cfc2 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:48.830795 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-3c4a1df3-1634-40ea-9fbc-cf930888cfc2 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 6803db4b-7556-4e4e-989c-adfa3d140a09] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:48.830961 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-992acd45-d0ef-40f7-a49d-6046e2156185 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] 10.222.0.48 "GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4" status: 200 len: 1593 microversion: 2.1 time: 0.162651 Jul 21 10:50:48.832690 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 322/628] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:48 2022] GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4 => generated 1593 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:50:48.837933 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3c4a1df3-1634-40ea-9fbc-cf930888cfc2 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:48.838697 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3c4a1df3-1634-40ea-9fbc-cf930888cfc2 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:48.839719 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3c4a1df3-1634-40ea-9fbc-cf930888cfc2 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:48.840364 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3c4a1df3-1634-40ea-9fbc-cf930888cfc2 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:48.937081 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-3c4a1df3-1634-40ea-9fbc-cf930888cfc2 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906e4bc4e9cc45ecb01cfca7918e461d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc215aadb5345d791945658832aae4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:48.945196 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-3c4a1df3-1634-40ea-9fbc-cf930888cfc2 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/6803db4b-7556-4e4e-989c-adfa3d140a09" status: 200 len: 1293 microversion: 2.1 time: 0.119907 Jul 21 10:50:48.945776 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 307/629] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:48 2022] GET /compute/v2.1/servers/6803db4b-7556-4e4e-989c-adfa3d140a09 => generated 1293 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:50:49.219640 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-e1fdd421-f3ec-4443-8b00-9e6a57588945 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:49.220473 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-e1fdd421-f3ec-4443-8b00-9e6a57588945 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: a54643be-3f53-4fe5-bab0-786b71d627bb] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:49.227191 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e1fdd421-f3ec-4443-8b00-9e6a57588945 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:49.227644 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e1fdd421-f3ec-4443-8b00-9e6a57588945 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:49.228414 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e1fdd421-f3ec-4443-8b00-9e6a57588945 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:49.229022 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e1fdd421-f3ec-4443-8b00-9e6a57588945 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:49.665455 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-e1fdd421-f3ec-4443-8b00-9e6a57588945 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:49.674287 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-e1fdd421-f3ec-4443-8b00-9e6a57588945 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb" status: 200 len: 1736 microversion: 2.1 time: 0.458993 Jul 21 10:50:49.675130 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 323/630] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:49 2022] GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb => generated 1736 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:50:49.962195 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-9f52804c-1490-422e-b554-d861dd0b9d78 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:49.962871 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-9f52804c-1490-422e-b554-d861dd0b9d78 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 6803db4b-7556-4e4e-989c-adfa3d140a09] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:49.969866 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9f52804c-1490-422e-b554-d861dd0b9d78 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:49.970311 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9f52804c-1490-422e-b554-d861dd0b9d78 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:49.971104 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9f52804c-1490-422e-b554-d861dd0b9d78 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:49.971564 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9f52804c-1490-422e-b554-d861dd0b9d78 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:50.034812 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-9f52804c-1490-422e-b554-d861dd0b9d78 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906e4bc4e9cc45ecb01cfca7918e461d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc215aadb5345d791945658832aae4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:50.042506 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-9f52804c-1490-422e-b554-d861dd0b9d78 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/6803db4b-7556-4e4e-989c-adfa3d140a09" status: 200 len: 1311 microversion: 2.1 time: 0.084166 Jul 21 10:50:50.043101 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 308/631] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:49 2022] GET /compute/v2.1/servers/6803db4b-7556-4e4e-989c-adfa3d140a09 => generated 1311 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:50:50.692191 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-d44a2e09-ea93-4c4b-9685-abbdd58e6689 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:50.693177 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-d44a2e09-ea93-4c4b-9685-abbdd58e6689 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: a54643be-3f53-4fe5-bab0-786b71d627bb] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:50.699114 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d44a2e09-ea93-4c4b-9685-abbdd58e6689 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:50.703237 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d44a2e09-ea93-4c4b-9685-abbdd58e6689 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:50.703237 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d44a2e09-ea93-4c4b-9685-abbdd58e6689 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:50.703237 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d44a2e09-ea93-4c4b-9685-abbdd58e6689 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:50.840127 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-d44a2e09-ea93-4c4b-9685-abbdd58e6689 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:50.848632 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-d44a2e09-ea93-4c4b-9685-abbdd58e6689 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb" status: 200 len: 1736 microversion: 2.1 time: 0.160571 Jul 21 10:50:50.849207 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 324/632] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:50 2022] GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:50:51.059985 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-b4847c05-434c-4021-a365-fbc9f77214e7 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:51.060624 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-b4847c05-434c-4021-a365-fbc9f77214e7 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 6803db4b-7556-4e4e-989c-adfa3d140a09] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:51.068127 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b4847c05-434c-4021-a365-fbc9f77214e7 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:51.068576 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b4847c05-434c-4021-a365-fbc9f77214e7 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:51.069352 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b4847c05-434c-4021-a365-fbc9f77214e7 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:51.069828 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b4847c05-434c-4021-a365-fbc9f77214e7 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:51.151523 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-b4847c05-434c-4021-a365-fbc9f77214e7 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906e4bc4e9cc45ecb01cfca7918e461d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc215aadb5345d791945658832aae4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:51.159692 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-b4847c05-434c-4021-a365-fbc9f77214e7 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/6803db4b-7556-4e4e-989c-adfa3d140a09" status: 200 len: 1299 microversion: 2.1 time: 0.103691 Jul 21 10:50:51.165421 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 309/633] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:51 2022] GET /compute/v2.1/servers/6803db4b-7556-4e4e-989c-adfa3d140a09 => generated 1299 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:50:51.284630 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [req-10f897ca-3066-4641-96b5-b3b652a13e61 req-93bd0304-9fa1-4838-841e-3c2822ba3db5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6597f555-38e1-4d14-bf7c-6d8b5e5a26d4", "tag": "24113ecd-45f8-473c-a1aa-fc93cff6c402"}]} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:50:51.292842 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-10f897ca-3066-4641-96b5-b3b652a13e61 req-93bd0304-9fa1-4838-841e-3c2822ba3db5 service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:51.293291 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-10f897ca-3066-4641-96b5-b3b652a13e61 req-93bd0304-9fa1-4838-841e-3c2822ba3db5 service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:51.306568 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.compute.server_external_events [req-10f897ca-3066-4641-96b5-b3b652a13e61 req-93bd0304-9fa1-4838-841e-3c2822ba3db5 service nova] Creating event network-changed:24113ecd-45f8-473c-a1aa-fc93cff6c402 for instance 6597f555-38e1-4d14-bf7c-6d8b5e5a26d4 on hv-cinder-84980 Jul 21 10:50:51.312175 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [req-10f897ca-3066-4641-96b5-b3b652a13e61 req-93bd0304-9fa1-4838-841e-3c2822ba3db5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032114 Jul 21 10:50:51.313390 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 325/634] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 21 10:50:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:50:51.870666 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-fe23cd8d-d035-49e9-93ed-7d5ee87a01a5 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:51.871725 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-fe23cd8d-d035-49e9-93ed-7d5ee87a01a5 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: a54643be-3f53-4fe5-bab0-786b71d627bb] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:51.881506 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-fe23cd8d-d035-49e9-93ed-7d5ee87a01a5 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:51.882997 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-fe23cd8d-d035-49e9-93ed-7d5ee87a01a5 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:51.884000 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-fe23cd8d-d035-49e9-93ed-7d5ee87a01a5 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:51.885453 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-fe23cd8d-d035-49e9-93ed-7d5ee87a01a5 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:52.139065 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-fe23cd8d-d035-49e9-93ed-7d5ee87a01a5 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:52.151056 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-fe23cd8d-d035-49e9-93ed-7d5ee87a01a5 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb" status: 200 len: 1716 microversion: 2.1 time: 0.287617 Jul 21 10:50:52.151855 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 310/635] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:51 2022] GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb => generated 1716 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:50:52.185890 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-6f0a780c-8970-4d5c-8aa3-106e7ea768e6 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:52.186977 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-6f0a780c-8970-4d5c-8aa3-106e7ea768e6 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 6803db4b-7556-4e4e-989c-adfa3d140a09] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:52.202445 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6f0a780c-8970-4d5c-8aa3-106e7ea768e6 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:52.211147 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6f0a780c-8970-4d5c-8aa3-106e7ea768e6 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:52.211147 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6f0a780c-8970-4d5c-8aa3-106e7ea768e6 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:52.211147 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6f0a780c-8970-4d5c-8aa3-106e7ea768e6 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:52.358846 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-3ba82839-91e2-4db5-ba98-6ea1019ed4cd tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:52.360275 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-3ba82839-91e2-4db5-ba98-6ea1019ed4cd tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: a54643be-3f53-4fe5-bab0-786b71d627bb] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:52.370842 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3ba82839-91e2-4db5-ba98-6ea1019ed4cd tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:52.371375 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3ba82839-91e2-4db5-ba98-6ea1019ed4cd tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:52.373177 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3ba82839-91e2-4db5-ba98-6ea1019ed4cd tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:52.374141 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3ba82839-91e2-4db5-ba98-6ea1019ed4cd tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:52.605642 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-6f0a780c-8970-4d5c-8aa3-106e7ea768e6 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906e4bc4e9cc45ecb01cfca7918e461d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc215aadb5345d791945658832aae4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:52.640401 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-6f0a780c-8970-4d5c-8aa3-106e7ea768e6 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/6803db4b-7556-4e4e-989c-adfa3d140a09" status: 200 len: 1366 microversion: 2.1 time: 0.458240 Jul 21 10:50:52.642902 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 326/636] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:52 2022] GET /compute/v2.1/servers/6803db4b-7556-4e4e-989c-adfa3d140a09 => generated 1366 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:50:52.662658 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.wsgi [None req-3ba82839-91e2-4db5-ba98-6ea1019ed4cd tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] HTTP exception thrown: Cannot 'detach_volume' instance a54643be-3f53-4fe5-bab0-786b71d627bb while it is in vm_state rescued Jul 21 10:50:52.664280 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-3ba82839-91e2-4db5-ba98-6ea1019ed4cd tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Request method failure captured: Jul 21 10:50:52.664280 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: request: DELETE /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb/os-volume_attachments/14daff22-cc81-4f39-a09e-4f34e374cfa0 HTTP/1.1 Jul 21 10:50:52.664280 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Accept: application/json Jul 21 10:50:52.664280 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Accept-Encoding: identity Jul 21 10:50:52.664280 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Connection: close Jul 21 10:50:52.664280 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Content-Length: 0 Jul 21 10:50:52.664280 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Content-Type: application/json Jul 21 10:50:52.664280 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Host: 10.222.0.48 Jul 21 10:50:52.664280 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Openstack-System-Scope: None Jul 21 10:50:52.664280 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: User-Agent: python-urllib3/1.26.9 Jul 21 10:50:52.664280 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Auth-Token: gAAAAABi2S6Ceh_4nWphJ8VOdl6H8HFNXSa-qaDU7JzSMyQFmKOVC1-s9RjoIDnnf0b6XhBtJZfkFCZ33MTu8R7SDlIHJinmYsY2WkcMWq4PFgA7k0PzgcXzqdQyXpT96ot3T9mRIIjamqovKw8w4rfRBreiHT2xSl4dltciMM60bd0k4iI4qGs Jul 21 10:50:52.664280 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Domain-Id: None Jul 21 10:50:52.664280 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Domain-Name: None Jul 21 10:50:52.664280 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Identity-Status: Confirmed Jul 21 10:50:52.664280 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Is-Admin-Project: True Jul 21 10:50:52.664280 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Domain-Id: default Jul 21 10:50:52.664280 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Domain-Name: Default Jul 21 10:50:52.664280 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Id: 2ff45af5bd82457b9fd080026ea65b5b Jul 21 10:50:52.664280 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1176570364 Jul 21 10:50:52.664280 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Role: reader,member Jul 21 10:50:52.664280 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Roles: reader,member Jul 21 10:50:52.665764 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2ff45af5bd82457b9fd080026ea65b5b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2ff45af5bd82457b9fd080026ea65b5b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2ff45af5bd82457b9fd080026ea65b5b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2ff45af5bd82457b9fd080026ea65b5b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] Jul 21 10:50:52.665764 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1176570364 Jul 21 10:50:52.665764 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Tenant-Id: 2ff45af5bd82457b9fd080026ea65b5b Jul 21 10:50:52.665764 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1176570364 Jul 21 10:50:52.665764 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User: tempest-ServerRescueNegativeTestJSON-1176570364-project Jul 21 10:50:52.665764 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Domain-Id: default Jul 21 10:50:52.665764 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Domain-Name: Default Jul 21 10:50:52.665764 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Id: a2cb1079722947dfa37946c03b7297a3 Jul 21 10:50:52.665764 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1176570364-project Jul 21 10:50:52.665764 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: method: > Jul 21 10:50:52.665764 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: exception: Cannot 'detach_volume' instance a54643be-3f53-4fe5-bab0-786b71d627bb while it is in vm_state rescued Jul 21 10:50:52.666469 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: action_args: {'server_id': 'a54643be-3f53-4fe5-bab0-786b71d627bb', 'id': '14daff22-cc81-4f39-a09e-4f34e374cfa0'} Jul 21 10:50:52.666469 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 10:50:52.666469 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:50:52.666469 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 21 10:50:52.666469 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 21 10:50:52.666469 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 21 10:50:52.666469 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 21 10:50:52.666469 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 21 10:50:52.666469 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 21 10:50:52.666469 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a54643be-3f53-4fe5-bab0-786b71d627bb in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 21 10:50:52.666469 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:50:52.666469 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:50:52.666469 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:50:52.666469 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:50:52.666469 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:50:52.666469 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:50:52.666469 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 10:50:52.666469 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 10:50:52.666469 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 10:50:52.666469 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 10:50:52.667842 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 21 10:50:52.667842 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 21 10:50:52.667842 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 21 10:50:52.667842 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 21 10:50:52.667842 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance a54643be-3f53-4fe5-bab0-786b71d627bb while it is in vm_state rescued Jul 21 10:50:52.667842 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:50:52.667842 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:50:52.667842 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:50:52.667842 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:50:52.667842 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:50:52.667842 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:50:52.667842 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 10:50:52.667842 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 10:50:52.667842 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance a54643be-3f53-4fe5-bab0-786b71d627bb while it is in vm_state rescued Jul 21 10:50:52.667842 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:50:52.667842 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-3ba82839-91e2-4db5-ba98-6ea1019ed4cd tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Returning 409 to user: Cannot 'detach_volume' instance a54643be-3f53-4fe5-bab0-786b71d627bb while it is in vm_state rescued {{(pid=124868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 10:50:52.668802 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-3ba82839-91e2-4db5-ba98-6ea1019ed4cd tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "DELETE /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb/os-volume_attachments/14daff22-cc81-4f39-a09e-4f34e374cfa0" status: 409 len: 152 microversion: 2.1 time: 0.311487 Jul 21 10:50:52.674945 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 311/637] 10.222.0.48 () {58 vars in 1415 bytes} [Thu Jul 21 10:50:52 2022] DELETE /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb/os-volume_attachments/14daff22-cc81-4f39-a09e-4f34e374cfa0 => generated 152 bytes in 321 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 21 10:50:52.676921 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-66f8e987-7793-4ae5-ac60-ce580163158d tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:50:52.677610 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-66f8e987-7793-4ae5-ac60-ce580163158d tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: a54643be-3f53-4fe5-bab0-786b71d627bb] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:52.685551 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-66f8e987-7793-4ae5-ac60-ce580163158d tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:52.689549 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-66f8e987-7793-4ae5-ac60-ce580163158d tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:52.690365 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-66f8e987-7793-4ae5-ac60-ce580163158d tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:52.691036 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-66f8e987-7793-4ae5-ac60-ce580163158d tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:52.750625 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:50:53.000352 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-66f8e987-7793-4ae5-ac60-ce580163158d tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "POST /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb/action" status: 202 len: 0 microversion: 2.1 time: 0.324512 Jul 21 10:50:53.000352 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 327/638] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 21 10:50:52 2022] POST /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb/action => generated 0 bytes in 326 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 10:50:53.005863 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-21c9194c-d41b-4cf0-a823-912d57a5e24f tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:53.006471 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-21c9194c-d41b-4cf0-a823-912d57a5e24f tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: a54643be-3f53-4fe5-bab0-786b71d627bb] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:53.013684 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-21c9194c-d41b-4cf0-a823-912d57a5e24f tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:53.014135 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-21c9194c-d41b-4cf0-a823-912d57a5e24f tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:53.014929 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-21c9194c-d41b-4cf0-a823-912d57a5e24f tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:53.015960 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-21c9194c-d41b-4cf0-a823-912d57a5e24f tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:53.212363 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-21c9194c-d41b-4cf0-a823-912d57a5e24f tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:53.222489 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-21c9194c-d41b-4cf0-a823-912d57a5e24f tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb" status: 200 len: 1724 microversion: 2.1 time: 0.220351 Jul 21 10:50:53.223098 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 312/639] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:53 2022] GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb => generated 1724 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:50:53.356322 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [req-6cd6e1d3-f554-4a3c-905c-8d599083a6ba req-4cbdadd4-ecae-47fa-bc41-b56baf686dac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6803db4b-7556-4e4e-989c-adfa3d140a09", "tag": "28698c15-1328-42b1-94dc-58f0f01666c1"}]} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:50:53.365498 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-6cd6e1d3-f554-4a3c-905c-8d599083a6ba req-4cbdadd4-ecae-47fa-bc41-b56baf686dac service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:53.366098 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-6cd6e1d3-f554-4a3c-905c-8d599083a6ba req-4cbdadd4-ecae-47fa-bc41-b56baf686dac service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:53.378098 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.compute.server_external_events [req-6cd6e1d3-f554-4a3c-905c-8d599083a6ba req-4cbdadd4-ecae-47fa-bc41-b56baf686dac service nova] Creating event network-changed:28698c15-1328-42b1-94dc-58f0f01666c1 for instance 6803db4b-7556-4e4e-989c-adfa3d140a09 on hv-cinder-84980 Jul 21 10:50:53.382949 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [req-6cd6e1d3-f554-4a3c-905c-8d599083a6ba req-4cbdadd4-ecae-47fa-bc41-b56baf686dac service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031931 Jul 21 10:50:53.383550 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 328/640] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 21 10:50:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 10:50:53.659437 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-017307f3-4e50-4c83-baf4-7f1b32865091 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:53.660058 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-017307f3-4e50-4c83-baf4-7f1b32865091 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 6803db4b-7556-4e4e-989c-adfa3d140a09] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:53.666044 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-017307f3-4e50-4c83-baf4-7f1b32865091 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:53.666493 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-017307f3-4e50-4c83-baf4-7f1b32865091 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:53.667295 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-017307f3-4e50-4c83-baf4-7f1b32865091 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:53.667733 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-017307f3-4e50-4c83-baf4-7f1b32865091 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:53.898232 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-017307f3-4e50-4c83-baf4-7f1b32865091 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906e4bc4e9cc45ecb01cfca7918e461d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc215aadb5345d791945658832aae4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:53.905690 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-017307f3-4e50-4c83-baf4-7f1b32865091 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/6803db4b-7556-4e4e-989c-adfa3d140a09" status: 200 len: 1366 microversion: 2.1 time: 0.250194 Jul 21 10:50:53.907006 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 313/641] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:53 2022] GET /compute/v2.1/servers/6803db4b-7556-4e4e-989c-adfa3d140a09 => generated 1366 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:50:54.239939 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-9c241381-223f-46ab-9edf-67337af4bc5f tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:54.240620 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-9c241381-223f-46ab-9edf-67337af4bc5f tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: a54643be-3f53-4fe5-bab0-786b71d627bb] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:54.247189 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9c241381-223f-46ab-9edf-67337af4bc5f tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:54.247713 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9c241381-223f-46ab-9edf-67337af4bc5f tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:54.248458 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9c241381-223f-46ab-9edf-67337af4bc5f tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:54.248888 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9c241381-223f-46ab-9edf-67337af4bc5f tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:54.384300 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-9c241381-223f-46ab-9edf-67337af4bc5f tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:54.396528 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-9c241381-223f-46ab-9edf-67337af4bc5f tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb" status: 200 len: 1724 microversion: 2.1 time: 0.157332 Jul 21 10:50:54.396528 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 329/642] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:54 2022] GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:50:54.534683 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-d71c1a65-1681-49f8-9beb-d07e6c601f64 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1818826965"}} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:50:54.535209 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-d71c1a65-1681-49f8-9beb-d07e6c601f64 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] [instance: 6597f555-38e1-4d14-bf7c-6d8b5e5a26d4] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:54.541617 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d71c1a65-1681-49f8-9beb-d07e6c601f64 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:54.542065 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d71c1a65-1681-49f8-9beb-d07e6c601f64 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:54.542846 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d71c1a65-1681-49f8-9beb-d07e6c601f64 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:54.543281 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d71c1a65-1681-49f8-9beb-d07e6c601f64 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:54.668286 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.network.security_group_api [None req-d71c1a65-1681-49f8-9beb-d07e6c601f64 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Adding security group c5ee5c4d-66ab-4d3f-a7cf-6badf584244d to port 24113ecd-45f8-473c-a1aa-fc93cff6c402 Jul 21 10:50:54.924140 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-aa3d2893-1b32-4988-bf48-dfebf5845b53 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:54.924646 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-aa3d2893-1b32-4988-bf48-dfebf5845b53 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 6803db4b-7556-4e4e-989c-adfa3d140a09] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:54.930672 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-aa3d2893-1b32-4988-bf48-dfebf5845b53 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:54.931122 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-aa3d2893-1b32-4988-bf48-dfebf5845b53 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:54.934006 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-aa3d2893-1b32-4988-bf48-dfebf5845b53 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:54.934006 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-aa3d2893-1b32-4988-bf48-dfebf5845b53 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:55.092782 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-aa3d2893-1b32-4988-bf48-dfebf5845b53 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906e4bc4e9cc45ecb01cfca7918e461d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc215aadb5345d791945658832aae4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:55.101426 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-aa3d2893-1b32-4988-bf48-dfebf5845b53 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/6803db4b-7556-4e4e-989c-adfa3d140a09" status: 200 len: 1366 microversion: 2.1 time: 0.181799 Jul 21 10:50:55.101994 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 330/643] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:54 2022] GET /compute/v2.1/servers/6803db4b-7556-4e4e-989c-adfa3d140a09 => generated 1366 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:50:55.134702 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-d71c1a65-1681-49f8-9beb-d07e6c601f64 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] 10.222.0.48 "POST /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4/action" status: 202 len: 0 microversion: 2.1 time: 0.604312 Jul 21 10:50:55.136784 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 314/644] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 21 10:50:54 2022] POST /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4/action => generated 0 bytes in 607 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 10:50:55.155654 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-bdde6ff3-0651-44a5-9929-370ee474dcfe tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:55.156604 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-bdde6ff3-0651-44a5-9929-370ee474dcfe tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] [instance: 6597f555-38e1-4d14-bf7c-6d8b5e5a26d4] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:55.162413 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [req-20dfbaea-1d47-4300-bf00-564bdf433e07 req-04cef7f5-0628-4e9a-b672-3050b5b17630 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6597f555-38e1-4d14-bf7c-6d8b5e5a26d4", "tag": "24113ecd-45f8-473c-a1aa-fc93cff6c402"}]} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:50:55.183204 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-bdde6ff3-0651-44a5-9929-370ee474dcfe tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:55.183861 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-bdde6ff3-0651-44a5-9929-370ee474dcfe tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:55.190494 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-bdde6ff3-0651-44a5-9929-370ee474dcfe tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:55.191161 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-bdde6ff3-0651-44a5-9929-370ee474dcfe tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:55.195028 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-20dfbaea-1d47-4300-bf00-564bdf433e07 req-04cef7f5-0628-4e9a-b672-3050b5b17630 service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:55.197881 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-20dfbaea-1d47-4300-bf00-564bdf433e07 req-04cef7f5-0628-4e9a-b672-3050b5b17630 service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:55.241330 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.compute.server_external_events [req-20dfbaea-1d47-4300-bf00-564bdf433e07 req-04cef7f5-0628-4e9a-b672-3050b5b17630 service nova] Creating event network-changed:24113ecd-45f8-473c-a1aa-fc93cff6c402 for instance 6597f555-38e1-4d14-bf7c-6d8b5e5a26d4 on hv-cinder-84980 Jul 21 10:50:55.255396 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [req-20dfbaea-1d47-4300-bf00-564bdf433e07 req-04cef7f5-0628-4e9a-b672-3050b5b17630 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110792 Jul 21 10:50:55.256008 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 331/645] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 21 10:50:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:50:55.413907 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-9f8a26d5-a808-43eb-832e-c287dc152786 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:55.415523 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-9f8a26d5-a808-43eb-832e-c287dc152786 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: a54643be-3f53-4fe5-bab0-786b71d627bb] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:55.427052 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell0:SELECT=2 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:50:55.432346 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9f8a26d5-a808-43eb-832e-c287dc152786 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:55.442661 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9f8a26d5-a808-43eb-832e-c287dc152786 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:55.442661 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9f8a26d5-a808-43eb-832e-c287dc152786 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:55.442661 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9f8a26d5-a808-43eb-832e-c287dc152786 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:55.462748 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-bdde6ff3-0651-44a5-9929-370ee474dcfe tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0271efe4b4e9592b29d9f124519b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eff05785bd84522ad637d8bed14563d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:55.481717 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-bdde6ff3-0651-44a5-9929-370ee474dcfe tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] 10.222.0.48 "GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4" status: 200 len: 1759 microversion: 2.1 time: 0.336237 Jul 21 10:50:55.493643 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 315/646] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:55 2022] GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4 => generated 1759 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:50:55.606521 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell0:SELECT=12 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:50:55.615323 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-9f8a26d5-a808-43eb-832e-c287dc152786 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:55.623088 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-9f8a26d5-a808-43eb-832e-c287dc152786 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb" status: 200 len: 1724 microversion: 2.1 time: 0.214784 Jul 21 10:50:55.623871 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 332/647] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:55 2022] GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb => generated 1724 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:50:56.118777 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-4e4115d4-dbba-4ee9-be63-478ed73d6a8e tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:56.119488 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-4e4115d4-dbba-4ee9-be63-478ed73d6a8e tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 6803db4b-7556-4e4e-989c-adfa3d140a09] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:56.126120 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4e4115d4-dbba-4ee9-be63-478ed73d6a8e tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:56.126581 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4e4115d4-dbba-4ee9-be63-478ed73d6a8e tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:56.127344 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4e4115d4-dbba-4ee9-be63-478ed73d6a8e tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:56.127774 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4e4115d4-dbba-4ee9-be63-478ed73d6a8e tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:56.263387 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-4e4115d4-dbba-4ee9-be63-478ed73d6a8e tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906e4bc4e9cc45ecb01cfca7918e461d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc215aadb5345d791945658832aae4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:56.271391 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-4e4115d4-dbba-4ee9-be63-478ed73d6a8e tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/6803db4b-7556-4e4e-989c-adfa3d140a09" status: 200 len: 1366 microversion: 2.1 time: 0.156568 Jul 21 10:50:56.272066 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 316/648] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:56 2022] GET /compute/v2.1/servers/6803db4b-7556-4e4e-989c-adfa3d140a09 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:50:56.641613 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-41bfabc7-c705-4f68-b3fc-95c334581c2d tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:56.642177 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-41bfabc7-c705-4f68-b3fc-95c334581c2d tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: a54643be-3f53-4fe5-bab0-786b71d627bb] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:56.649413 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-41bfabc7-c705-4f68-b3fc-95c334581c2d tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:56.649862 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-41bfabc7-c705-4f68-b3fc-95c334581c2d tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:56.650653 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-41bfabc7-c705-4f68-b3fc-95c334581c2d tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:56.651091 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-41bfabc7-c705-4f68-b3fc-95c334581c2d tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:56.784767 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-41bfabc7-c705-4f68-b3fc-95c334581c2d tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:56.792703 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-41bfabc7-c705-4f68-b3fc-95c334581c2d tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb" status: 200 len: 1724 microversion: 2.1 time: 0.155256 Jul 21 10:50:56.793264 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 333/649] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:56 2022] GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:50:57.289388 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-aca01f52-d799-43bb-83f1-3828cc4d3af1 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:57.289996 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-aca01f52-d799-43bb-83f1-3828cc4d3af1 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 6803db4b-7556-4e4e-989c-adfa3d140a09] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:57.296486 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-aca01f52-d799-43bb-83f1-3828cc4d3af1 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:57.297081 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-aca01f52-d799-43bb-83f1-3828cc4d3af1 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:57.297690 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-aca01f52-d799-43bb-83f1-3828cc4d3af1 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:57.298117 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-aca01f52-d799-43bb-83f1-3828cc4d3af1 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:57.469592 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-aca01f52-d799-43bb-83f1-3828cc4d3af1 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906e4bc4e9cc45ecb01cfca7918e461d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc215aadb5345d791945658832aae4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:57.477292 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-aca01f52-d799-43bb-83f1-3828cc4d3af1 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/6803db4b-7556-4e4e-989c-adfa3d140a09" status: 200 len: 1366 microversion: 2.1 time: 0.191604 Jul 21 10:50:57.477875 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 317/650] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:57 2022] GET /compute/v2.1/servers/6803db4b-7556-4e4e-989c-adfa3d140a09 => generated 1366 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:50:57.811007 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-14d7bc53-2a4a-47d6-9e48-79998d7844d6 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:57.811713 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-14d7bc53-2a4a-47d6-9e48-79998d7844d6 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: a54643be-3f53-4fe5-bab0-786b71d627bb] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:57.816166 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:50:57.821384 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-14d7bc53-2a4a-47d6-9e48-79998d7844d6 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:57.821833 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-14d7bc53-2a4a-47d6-9e48-79998d7844d6 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:57.822615 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-14d7bc53-2a4a-47d6-9e48-79998d7844d6 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:57.823049 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-14d7bc53-2a4a-47d6-9e48-79998d7844d6 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:57.958999 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-14d7bc53-2a4a-47d6-9e48-79998d7844d6 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:57.967326 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-14d7bc53-2a4a-47d6-9e48-79998d7844d6 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb" status: 200 len: 1724 microversion: 2.1 time: 0.160106 Jul 21 10:50:57.967901 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 334/651] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:57 2022] GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:50:58.494406 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-e47e666d-9926-41f4-ab33-061148be3e51 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:58.495043 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-e47e666d-9926-41f4-ab33-061148be3e51 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 6803db4b-7556-4e4e-989c-adfa3d140a09] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:58.502342 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e47e666d-9926-41f4-ab33-061148be3e51 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:58.502863 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e47e666d-9926-41f4-ab33-061148be3e51 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:58.503628 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e47e666d-9926-41f4-ab33-061148be3e51 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:58.504060 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e47e666d-9926-41f4-ab33-061148be3e51 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:58.632496 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-e47e666d-9926-41f4-ab33-061148be3e51 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906e4bc4e9cc45ecb01cfca7918e461d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc215aadb5345d791945658832aae4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:58.640058 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-e47e666d-9926-41f4-ab33-061148be3e51 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/6803db4b-7556-4e4e-989c-adfa3d140a09" status: 200 len: 1366 microversion: 2.1 time: 0.149545 Jul 21 10:50:58.641211 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 318/652] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:58 2022] GET /compute/v2.1/servers/6803db4b-7556-4e4e-989c-adfa3d140a09 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:50:58.985300 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-f87b0f32-d202-4a92-96a5-add367875914 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:58.985904 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-f87b0f32-d202-4a92-96a5-add367875914 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: a54643be-3f53-4fe5-bab0-786b71d627bb] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:58.992395 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f87b0f32-d202-4a92-96a5-add367875914 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:58.992845 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f87b0f32-d202-4a92-96a5-add367875914 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:58.993609 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f87b0f32-d202-4a92-96a5-add367875914 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:58.994213 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f87b0f32-d202-4a92-96a5-add367875914 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:59.121569 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-f87b0f32-d202-4a92-96a5-add367875914 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:50:59.129970 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-f87b0f32-d202-4a92-96a5-add367875914 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb" status: 200 len: 1730 microversion: 2.1 time: 0.149209 Jul 21 10:50:59.130531 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 335/653] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:58 2022] GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb => generated 1730 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:50:59.147096 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-ed3b8938-662f-4776-b59e-5149270578d5 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:59.147592 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-ed3b8938-662f-4776-b59e-5149270578d5 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: a54643be-3f53-4fe5-bab0-786b71d627bb] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:59.153495 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ed3b8938-662f-4776-b59e-5149270578d5 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:59.154004 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ed3b8938-662f-4776-b59e-5149270578d5 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:59.154745 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ed3b8938-662f-4776-b59e-5149270578d5 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:59.155184 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ed3b8938-662f-4776-b59e-5149270578d5 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:59.157570 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:50:59.231553 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-ed3b8938-662f-4776-b59e-5149270578d5 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088347 Jul 21 10:50:59.232159 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 319/654] 10.222.0.48 () {58 vars in 1274 bytes} [Thu Jul 21 10:50:59 2022] GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:50:59.658508 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-ffa420ed-988a-4e11-8500-8fa85f918c20 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:50:59.659161 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-ffa420ed-988a-4e11-8500-8fa85f918c20 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 6803db4b-7556-4e4e-989c-adfa3d140a09] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:50:59.678192 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ffa420ed-988a-4e11-8500-8fa85f918c20 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:59.678620 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ffa420ed-988a-4e11-8500-8fa85f918c20 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:59.679334 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ffa420ed-988a-4e11-8500-8fa85f918c20 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:59.679763 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ffa420ed-988a-4e11-8500-8fa85f918c20 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:59.868118 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [req-8377ba8d-b19f-4a42-898d-87f411c638e9 req-67ab9974-4b30-45bf-bdd3-2449e6dfd2a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6803db4b-7556-4e4e-989c-adfa3d140a09", "name": "network-vif-plugged", "status": "completed", "tag": "28698c15-1328-42b1-94dc-58f0f01666c1"}]} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:50:59.879145 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-8377ba8d-b19f-4a42-898d-87f411c638e9 req-67ab9974-4b30-45bf-bdd3-2449e6dfd2a4 service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:50:59.879576 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-8377ba8d-b19f-4a42-898d-87f411c638e9 req-67ab9974-4b30-45bf-bdd3-2449e6dfd2a4 service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:50:59.892893 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.compute.server_external_events [req-8377ba8d-b19f-4a42-898d-87f411c638e9 req-67ab9974-4b30-45bf-bdd3-2449e6dfd2a4 service nova] Creating event network-vif-plugged:28698c15-1328-42b1-94dc-58f0f01666c1 for instance 6803db4b-7556-4e4e-989c-adfa3d140a09 on hv-cinder-84980 Jul 21 10:50:59.898293 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [req-8377ba8d-b19f-4a42-898d-87f411c638e9 req-67ab9974-4b30-45bf-bdd3-2449e6dfd2a4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034109 Jul 21 10:50:59.899056 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 320/655] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 21 10:50:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 10:51:00.154060 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-ffa420ed-988a-4e11-8500-8fa85f918c20 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906e4bc4e9cc45ecb01cfca7918e461d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc215aadb5345d791945658832aae4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:51:00.162799 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-ffa420ed-988a-4e11-8500-8fa85f918c20 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/6803db4b-7556-4e4e-989c-adfa3d140a09" status: 200 len: 1366 microversion: 2.1 time: 0.509259 Jul 21 10:51:00.172452 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 336/656] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:50:59 2022] GET /compute/v2.1/servers/6803db4b-7556-4e4e-989c-adfa3d140a09 => generated 1366 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:51:00.711481 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [req-fd294ddf-9077-4887-8e9e-00c641c5caaa req-3c72019b-dd48-4b67-bb7d-37d8ab57cbea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a54643be-3f53-4fe5-bab0-786b71d627bb", "tag": "6ac84834-b64c-48e6-a97a-aed57229fe41"}]} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:51:00.721213 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-fd294ddf-9077-4887-8e9e-00c641c5caaa req-3c72019b-dd48-4b67-bb7d-37d8ab57cbea service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:00.721737 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-fd294ddf-9077-4887-8e9e-00c641c5caaa req-3c72019b-dd48-4b67-bb7d-37d8ab57cbea service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:00.732715 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.compute.server_external_events [req-fd294ddf-9077-4887-8e9e-00c641c5caaa req-3c72019b-dd48-4b67-bb7d-37d8ab57cbea service nova] Creating event network-changed:6ac84834-b64c-48e6-a97a-aed57229fe41 for instance a54643be-3f53-4fe5-bab0-786b71d627bb on hv-cinder-84980 Jul 21 10:51:00.738246 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [req-fd294ddf-9077-4887-8e9e-00c641c5caaa req-3c72019b-dd48-4b67-bb7d-37d8ab57cbea service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030863 Jul 21 10:51:00.739230 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 321/657] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 21 10:51:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:51:01.179832 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-4e3ad3cd-1a9f-480f-8e58-43d3897a97c8 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:51:01.180447 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-4e3ad3cd-1a9f-480f-8e58-43d3897a97c8 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 6803db4b-7556-4e4e-989c-adfa3d140a09] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:51:01.192507 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-4e3ad3cd-1a9f-480f-8e58-43d3897a97c8 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:01.192986 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-4e3ad3cd-1a9f-480f-8e58-43d3897a97c8 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:01.193775 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-4e3ad3cd-1a9f-480f-8e58-43d3897a97c8 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:01.194242 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-4e3ad3cd-1a9f-480f-8e58-43d3897a97c8 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:01.327401 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-4e3ad3cd-1a9f-480f-8e58-43d3897a97c8 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906e4bc4e9cc45ecb01cfca7918e461d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc215aadb5345d791945658832aae4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:51:01.335700 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-4e3ad3cd-1a9f-480f-8e58-43d3897a97c8 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/6803db4b-7556-4e4e-989c-adfa3d140a09" status: 200 len: 1366 microversion: 2.1 time: 0.159860 Jul 21 10:51:01.336268 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 337/658] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:51:01 2022] GET /compute/v2.1/servers/6803db4b-7556-4e4e-989c-adfa3d140a09 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:51:02.354577 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-3ac5de04-f37b-4f40-82f1-90d252dbfa24 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:51:02.355275 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-3ac5de04-f37b-4f40-82f1-90d252dbfa24 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 6803db4b-7556-4e4e-989c-adfa3d140a09] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:51:02.362020 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3ac5de04-f37b-4f40-82f1-90d252dbfa24 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:02.362460 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3ac5de04-f37b-4f40-82f1-90d252dbfa24 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:02.363233 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3ac5de04-f37b-4f40-82f1-90d252dbfa24 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:02.363664 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3ac5de04-f37b-4f40-82f1-90d252dbfa24 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:02.498068 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-3ac5de04-f37b-4f40-82f1-90d252dbfa24 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906e4bc4e9cc45ecb01cfca7918e461d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc215aadb5345d791945658832aae4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:51:02.505469 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-3ac5de04-f37b-4f40-82f1-90d252dbfa24 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/6803db4b-7556-4e4e-989c-adfa3d140a09" status: 200 len: 1366 microversion: 2.1 time: 0.155576 Jul 21 10:51:02.506028 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 322/659] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:51:02 2022] GET /compute/v2.1/servers/6803db4b-7556-4e4e-989c-adfa3d140a09 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:51:02.753704 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [req-144f04f7-c065-4a0a-bed5-b0bb4faa7776 req-660fd774-92f8-4538-bcab-0e44acbcfb04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a54643be-3f53-4fe5-bab0-786b71d627bb", "tag": "6ac84834-b64c-48e6-a97a-aed57229fe41"}]} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:51:02.762123 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-144f04f7-c065-4a0a-bed5-b0bb4faa7776 req-660fd774-92f8-4538-bcab-0e44acbcfb04 service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:02.762656 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-144f04f7-c065-4a0a-bed5-b0bb4faa7776 req-660fd774-92f8-4538-bcab-0e44acbcfb04 service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:02.774058 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.compute.server_external_events [req-144f04f7-c065-4a0a-bed5-b0bb4faa7776 req-660fd774-92f8-4538-bcab-0e44acbcfb04 service nova] Creating event network-changed:6ac84834-b64c-48e6-a97a-aed57229fe41 for instance a54643be-3f53-4fe5-bab0-786b71d627bb on hv-cinder-84980 Jul 21 10:51:02.779069 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [req-144f04f7-c065-4a0a-bed5-b0bb4faa7776 req-660fd774-92f8-4538-bcab-0e44acbcfb04 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029450 Jul 21 10:51:02.779634 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 338/660] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 21 10:51:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 10:51:03.522263 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-e8b3efa7-70b7-4db3-ab7e-9ef3a1a33eb8 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:51:03.522825 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-e8b3efa7-70b7-4db3-ab7e-9ef3a1a33eb8 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 6803db4b-7556-4e4e-989c-adfa3d140a09] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:51:03.529343 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e8b3efa7-70b7-4db3-ab7e-9ef3a1a33eb8 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:03.529792 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e8b3efa7-70b7-4db3-ab7e-9ef3a1a33eb8 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:03.530567 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e8b3efa7-70b7-4db3-ab7e-9ef3a1a33eb8 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:03.531059 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e8b3efa7-70b7-4db3-ab7e-9ef3a1a33eb8 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:03.658285 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-e8b3efa7-70b7-4db3-ab7e-9ef3a1a33eb8 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906e4bc4e9cc45ecb01cfca7918e461d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc215aadb5345d791945658832aae4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:51:03.665663 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-e8b3efa7-70b7-4db3-ab7e-9ef3a1a33eb8 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/6803db4b-7556-4e4e-989c-adfa3d140a09" status: 200 len: 1366 microversion: 2.1 time: 0.147311 Jul 21 10:51:03.666225 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 323/661] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:51:03 2022] GET /compute/v2.1/servers/6803db4b-7556-4e4e-989c-adfa3d140a09 => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:51:04.683263 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-82400dd8-782f-4a45-af9f-f9306c2ee293 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:51:04.683954 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-82400dd8-782f-4a45-af9f-f9306c2ee293 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 6803db4b-7556-4e4e-989c-adfa3d140a09] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:51:04.690775 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-82400dd8-782f-4a45-af9f-f9306c2ee293 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:04.691222 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-82400dd8-782f-4a45-af9f-f9306c2ee293 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:04.693052 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-82400dd8-782f-4a45-af9f-f9306c2ee293 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:04.693052 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-82400dd8-782f-4a45-af9f-f9306c2ee293 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:04.821433 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-82400dd8-782f-4a45-af9f-f9306c2ee293 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906e4bc4e9cc45ecb01cfca7918e461d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc215aadb5345d791945658832aae4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:51:04.829396 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-82400dd8-782f-4a45-af9f-f9306c2ee293 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/6803db4b-7556-4e4e-989c-adfa3d140a09" status: 200 len: 1366 microversion: 2.1 time: 0.150291 Jul 21 10:51:04.829967 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 339/662] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:51:04 2022] GET /compute/v2.1/servers/6803db4b-7556-4e4e-989c-adfa3d140a09 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:51:05.846357 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-6958cbfe-9077-4dd0-9773-f3ecc6372ba1 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:51:05.847024 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-6958cbfe-9077-4dd0-9773-f3ecc6372ba1 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 6803db4b-7556-4e4e-989c-adfa3d140a09] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:51:05.853389 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6958cbfe-9077-4dd0-9773-f3ecc6372ba1 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:05.853838 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6958cbfe-9077-4dd0-9773-f3ecc6372ba1 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:05.854624 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6958cbfe-9077-4dd0-9773-f3ecc6372ba1 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:05.855212 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6958cbfe-9077-4dd0-9773-f3ecc6372ba1 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:06.005097 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-6958cbfe-9077-4dd0-9773-f3ecc6372ba1 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906e4bc4e9cc45ecb01cfca7918e461d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc215aadb5345d791945658832aae4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:51:06.012480 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-6958cbfe-9077-4dd0-9773-f3ecc6372ba1 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/6803db4b-7556-4e4e-989c-adfa3d140a09" status: 200 len: 1556 microversion: 2.1 time: 0.170991 Jul 21 10:51:06.013046 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 324/663] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:51:05 2022] GET /compute/v2.1/servers/6803db4b-7556-4e4e-989c-adfa3d140a09 => generated 1556 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:51:06.029088 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-efdd7c3a-aca5-4c76-b856-1695128429ec tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:51:06.029596 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-efdd7c3a-aca5-4c76-b856-1695128429ec tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 6803db4b-7556-4e4e-989c-adfa3d140a09] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:51:06.036616 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-efdd7c3a-aca5-4c76-b856-1695128429ec tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:06.037066 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-efdd7c3a-aca5-4c76-b856-1695128429ec tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:06.037826 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-efdd7c3a-aca5-4c76-b856-1695128429ec tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:06.038261 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-efdd7c3a-aca5-4c76-b856-1695128429ec tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:06.114400 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-efdd7c3a-aca5-4c76-b856-1695128429ec tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/6803db4b-7556-4e4e-989c-adfa3d140a09/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089110 Jul 21 10:51:06.115043 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 340/664] 10.222.0.48 () {58 vars in 1274 bytes} [Thu Jul 21 10:51:06 2022] GET /compute/v2.1/servers/6803db4b-7556-4e4e-989c-adfa3d140a09/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:51:07.128459 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [req-86f5ccf9-737a-4039-9f3f-533d65d96d56 req-90e98d02-4364-4671-bc65-87099902db1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6803db4b-7556-4e4e-989c-adfa3d140a09", "tag": "28698c15-1328-42b1-94dc-58f0f01666c1"}]} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:51:07.137354 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-86f5ccf9-737a-4039-9f3f-533d65d96d56 req-90e98d02-4364-4671-bc65-87099902db1e service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:07.137791 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-86f5ccf9-737a-4039-9f3f-533d65d96d56 req-90e98d02-4364-4671-bc65-87099902db1e service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:07.149425 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.compute.server_external_events [req-86f5ccf9-737a-4039-9f3f-533d65d96d56 req-90e98d02-4364-4671-bc65-87099902db1e service nova] Creating event network-changed:28698c15-1328-42b1-94dc-58f0f01666c1 for instance 6803db4b-7556-4e4e-989c-adfa3d140a09 on hv-cinder-84980 Jul 21 10:51:07.154442 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [req-86f5ccf9-737a-4039-9f3f-533d65d96d56 req-90e98d02-4364-4671-bc65-87099902db1e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030278 Jul 21 10:51:07.155069 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 325/665] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 21 10:51:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:51:12.955272 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-89310ba1-9885-4b78-bd07-2a66861ef215 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:51:12.955773 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-89310ba1-9885-4b78-bd07-2a66861ef215 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] [instance: 082cef74-9509-4b17-8250-cd6527a6e3eb] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:51:12.961642 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-89310ba1-9885-4b78-bd07-2a66861ef215 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:12.962084 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-89310ba1-9885-4b78-bd07-2a66861ef215 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:12.962872 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-89310ba1-9885-4b78-bd07-2a66861ef215 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:12.963302 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-89310ba1-9885-4b78-bd07-2a66861ef215 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:13.143810 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.objects.instance [None req-89310ba1-9885-4b78-bd07-2a66861ef215 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lazy-loading 'services' on Instance uuid 082cef74-9509-4b17-8250-cd6527a6e3eb {{(pid=124867) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 10:51:13.351383 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-89310ba1-9885-4b78-bd07-2a66861ef215 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] 10.222.0.48 "DELETE /compute/v2.1/servers/082cef74-9509-4b17-8250-cd6527a6e3eb/os-volume_attachments/f63ea6d4-a5f4-429b-b394-9ce173ccab32" status: 202 len: 0 microversion: 2.1 time: 0.401066 Jul 21 10:51:13.352043 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 341/666] 10.222.0.48 () {58 vars in 1415 bytes} [Thu Jul 21 10:51:12 2022] DELETE /compute/v2.1/servers/082cef74-9509-4b17-8250-cd6527a6e3eb/os-volume_attachments/f63ea6d4-a5f4-429b-b394-9ce173ccab32 => generated 0 bytes in 403 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 10:51:15.517566 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-abc23544-d608-4a4d-9815-9e1925b23ce9 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:51:15.518156 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-abc23544-d608-4a4d-9815-9e1925b23ce9 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] [instance: 082cef74-9509-4b17-8250-cd6527a6e3eb] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:51:15.520802 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_api:SELECT=46 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:51:15.525687 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-abc23544-d608-4a4d-9815-9e1925b23ce9 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:15.526138 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-abc23544-d608-4a4d-9815-9e1925b23ce9 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:15.526973 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-abc23544-d608-4a4d-9815-9e1925b23ce9 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:15.527411 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-abc23544-d608-4a4d-9815-9e1925b23ce9 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:15.554189 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-abc23544-d608-4a4d-9815-9e1925b23ce9 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] [instance: 082cef74-9509-4b17-8250-cd6527a6e3eb] Going to try to terminate instance {{(pid=124868) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 10:51:15.756809 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-abc23544-d608-4a4d-9815-9e1925b23ce9 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] 10.222.0.48 "DELETE /compute/v2.1/servers/082cef74-9509-4b17-8250-cd6527a6e3eb" status: 204 len: 0 microversion: 2.1 time: 0.243243 Jul 21 10:51:15.757337 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 326/667] 10.222.0.48 () {58 vars in 1238 bytes} [Thu Jul 21 10:51:15 2022] DELETE /compute/v2.1/servers/082cef74-9509-4b17-8250-cd6527a6e3eb => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 10:51:15.767043 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-1ac72d84-b124-4177-a853-b07a9b9e349c tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:51:15.768004 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-1ac72d84-b124-4177-a853-b07a9b9e349c tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] [instance: 082cef74-9509-4b17-8250-cd6527a6e3eb] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:51:15.774298 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1ac72d84-b124-4177-a853-b07a9b9e349c tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:15.774789 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1ac72d84-b124-4177-a853-b07a9b9e349c tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:15.775553 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1ac72d84-b124-4177-a853-b07a9b9e349c tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:15.775991 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1ac72d84-b124-4177-a853-b07a9b9e349c tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:15.906345 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-1ac72d84-b124-4177-a853-b07a9b9e349c tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ccc2d61c7045a8abba95e7cd002a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24d5a2477eb74d5da5911b37f9031110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:51:15.914622 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-1ac72d84-b124-4177-a853-b07a9b9e349c tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] 10.222.0.48 "GET /compute/v2.1/servers/082cef74-9509-4b17-8250-cd6527a6e3eb" status: 200 len: 1515 microversion: 2.1 time: 0.152779 Jul 21 10:51:15.915230 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 342/668] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:51:15 2022] GET /compute/v2.1/servers/082cef74-9509-4b17-8250-cd6527a6e3eb => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:51:16.932710 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-50ec1b91-0b66-4a8c-bca6-8f6def4a4a8b tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:51:16.933454 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-50ec1b91-0b66-4a8c-bca6-8f6def4a4a8b tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] [instance: 082cef74-9509-4b17-8250-cd6527a6e3eb] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:51:16.940111 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-50ec1b91-0b66-4a8c-bca6-8f6def4a4a8b tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:16.940556 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-50ec1b91-0b66-4a8c-bca6-8f6def4a4a8b tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:16.941304 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-50ec1b91-0b66-4a8c-bca6-8f6def4a4a8b tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:16.941728 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-50ec1b91-0b66-4a8c-bca6-8f6def4a4a8b tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:17.124654 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-50ec1b91-0b66-4a8c-bca6-8f6def4a4a8b tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ccc2d61c7045a8abba95e7cd002a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24d5a2477eb74d5da5911b37f9031110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:51:17.132897 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-50ec1b91-0b66-4a8c-bca6-8f6def4a4a8b tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] 10.222.0.48 "GET /compute/v2.1/servers/082cef74-9509-4b17-8250-cd6527a6e3eb" status: 200 len: 1515 microversion: 2.1 time: 0.204337 Jul 21 10:51:17.133496 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 327/669] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:51:16 2022] GET /compute/v2.1/servers/082cef74-9509-4b17-8250-cd6527a6e3eb => generated 1515 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:51:18.151134 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-1ca963bb-5b24-46a1-9f1d-0e8ef63db443 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:51:18.151839 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-1ca963bb-5b24-46a1-9f1d-0e8ef63db443 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] [instance: 082cef74-9509-4b17-8250-cd6527a6e3eb] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:51:18.158704 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1ca963bb-5b24-46a1-9f1d-0e8ef63db443 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:18.159151 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1ca963bb-5b24-46a1-9f1d-0e8ef63db443 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:18.159915 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1ca963bb-5b24-46a1-9f1d-0e8ef63db443 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:18.160348 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1ca963bb-5b24-46a1-9f1d-0e8ef63db443 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:18.294699 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-1ca963bb-5b24-46a1-9f1d-0e8ef63db443 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ccc2d61c7045a8abba95e7cd002a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24d5a2477eb74d5da5911b37f9031110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:51:18.302190 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-1ca963bb-5b24-46a1-9f1d-0e8ef63db443 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] 10.222.0.48 "GET /compute/v2.1/servers/082cef74-9509-4b17-8250-cd6527a6e3eb" status: 200 len: 1515 microversion: 2.1 time: 0.154974 Jul 21 10:51:18.302780 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 343/670] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:51:18 2022] GET /compute/v2.1/servers/082cef74-9509-4b17-8250-cd6527a6e3eb => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:51:18.643211 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [req-c330607e-ee59-4351-8ab2-965dae8c9dd6 req-c9d3c095-8564-4baa-b066-e703489c84fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "082cef74-9509-4b17-8250-cd6527a6e3eb", "name": "network-vif-deleted", "tag": "9b9a006a-5edb-47a3-8eaf-9ce87c8cab27"}]} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:51:18.651989 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-c330607e-ee59-4351-8ab2-965dae8c9dd6 req-c9d3c095-8564-4baa-b066-e703489c84fd service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:18.652439 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-c330607e-ee59-4351-8ab2-965dae8c9dd6 req-c9d3c095-8564-4baa-b066-e703489c84fd service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:18.664148 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.compute.server_external_events [req-c330607e-ee59-4351-8ab2-965dae8c9dd6 req-c9d3c095-8564-4baa-b066-e703489c84fd service nova] Creating event network-vif-deleted:9b9a006a-5edb-47a3-8eaf-9ce87c8cab27 for instance 082cef74-9509-4b17-8250-cd6527a6e3eb on hv-cinder-84980 Jul 21 10:51:18.674381 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [req-c330607e-ee59-4351-8ab2-965dae8c9dd6 req-c9d3c095-8564-4baa-b066-e703489c84fd service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035846 Jul 21 10:51:18.685462 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 328/671] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 21 10:51:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:51:19.320002 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-7c98bc98-87c4-4ca4-9a9c-b299525f1d1f tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:51:19.320613 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-7c98bc98-87c4-4ca4-9a9c-b299525f1d1f tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] [instance: 082cef74-9509-4b17-8250-cd6527a6e3eb] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:51:19.327082 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7c98bc98-87c4-4ca4-9a9c-b299525f1d1f tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:19.327534 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7c98bc98-87c4-4ca4-9a9c-b299525f1d1f tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:19.328288 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7c98bc98-87c4-4ca4-9a9c-b299525f1d1f tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:19.329380 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7c98bc98-87c4-4ca4-9a9c-b299525f1d1f tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:19.361290 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7c98bc98-87c4-4ca4-9a9c-b299525f1d1f tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:19.361731 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7c98bc98-87c4-4ca4-9a9c-b299525f1d1f tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:19.362175 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.objects.instance [None req-7c98bc98-87c4-4ca4-9a9c-b299525f1d1f tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lazy-loading 'fault' on Instance uuid 082cef74-9509-4b17-8250-cd6527a6e3eb {{(pid=124867) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 10:51:19.402015 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-7c98bc98-87c4-4ca4-9a9c-b299525f1d1f tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ccc2d61c7045a8abba95e7cd002a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24d5a2477eb74d5da5911b37f9031110', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:51:19.409514 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-7c98bc98-87c4-4ca4-9a9c-b299525f1d1f tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] 10.222.0.48 "GET /compute/v2.1/servers/082cef74-9509-4b17-8250-cd6527a6e3eb" status: 200 len: 1309 microversion: 2.1 time: 0.093311 Jul 21 10:51:19.410078 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 344/672] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:51:19 2022] GET /compute/v2.1/servers/082cef74-9509-4b17-8250-cd6527a6e3eb => generated 1309 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:51:20.427185 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-f2377ce6-503d-4f5e-a687-b413ad3a8562 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:51:20.427882 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-f2377ce6-503d-4f5e-a687-b413ad3a8562 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] [instance: 082cef74-9509-4b17-8250-cd6527a6e3eb] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:51:20.434568 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f2377ce6-503d-4f5e-a687-b413ad3a8562 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:20.435013 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f2377ce6-503d-4f5e-a687-b413ad3a8562 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:20.435769 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f2377ce6-503d-4f5e-a687-b413ad3a8562 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:20.436195 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f2377ce6-503d-4f5e-a687-b413ad3a8562 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:20.449387 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.wsgi [None req-f2377ce6-503d-4f5e-a687-b413ad3a8562 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] HTTP exception thrown: Instance 082cef74-9509-4b17-8250-cd6527a6e3eb could not be found. Jul 21 10:51:20.450973 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-f2377ce6-503d-4f5e-a687-b413ad3a8562 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Request method failure captured: Jul 21 10:51:20.450973 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: request: GET /compute/v2.1/servers/082cef74-9509-4b17-8250-cd6527a6e3eb HTTP/1.1 Jul 21 10:51:20.450973 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Accept: application/json Jul 21 10:51:20.450973 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Accept-Encoding: identity Jul 21 10:51:20.450973 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Connection: close Jul 21 10:51:20.450973 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Content-Length: 0 Jul 21 10:51:20.450973 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Content-Type: application/json Jul 21 10:51:20.450973 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Host: 10.222.0.48 Jul 21 10:51:20.450973 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Openstack-System-Scope: None Jul 21 10:51:20.450973 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: User-Agent: python-urllib3/1.26.9 Jul 21 10:51:20.450973 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Auth-Token: gAAAAABi2S7713n_e268krRyt-l_6ueqSfTi79OB537IIhyBzbeaJhdaFQ0biQzKIH7_TfqoLC4TOY8aCBn2jlVOSuzqLI_MHQrxGAC1u8OCRycxFd6rsClvn8CfaPHKpJzhPRFQ3Ojx7JGub20QrBxaeUFZuGNq7FgxAi7CjWh6hbhJJ6scAaI Jul 21 10:51:20.450973 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Domain-Id: None Jul 21 10:51:20.450973 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Domain-Name: None Jul 21 10:51:20.450973 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Identity-Status: Confirmed Jul 21 10:51:20.450973 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Is-Admin-Project: True Jul 21 10:51:20.450973 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Domain-Id: default Jul 21 10:51:20.450973 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Domain-Name: Default Jul 21 10:51:20.450973 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Id: 24d5a2477eb74d5da5911b37f9031110 Jul 21 10:51:20.450973 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1148368882 Jul 21 10:51:20.450973 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Role: reader,member Jul 21 10:51:20.450973 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Roles: reader,member Jul 21 10:51:20.452544 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/24d5a2477eb74d5da5911b37f9031110"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/24d5a2477eb74d5da5911b37f9031110"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/24d5a2477eb74d5da5911b37f9031110"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_24d5a2477eb74d5da5911b37f9031110"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] Jul 21 10:51:20.452544 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Tenant: tempest-VolumesSnapshotTestJSON-1148368882 Jul 21 10:51:20.452544 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Tenant-Id: 24d5a2477eb74d5da5911b37f9031110 Jul 21 10:51:20.452544 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1148368882 Jul 21 10:51:20.452544 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User: tempest-VolumesSnapshotTestJSON-1148368882-project Jul 21 10:51:20.452544 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Domain-Id: default Jul 21 10:51:20.452544 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Domain-Name: Default Jul 21 10:51:20.452544 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Id: 26ccc2d61c7045a8abba95e7cd002a0a Jul 21 10:51:20.452544 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Name: tempest-VolumesSnapshotTestJSON-1148368882-project Jul 21 10:51:20.452544 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: method: > Jul 21 10:51:20.452544 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: exception: Instance 082cef74-9509-4b17-8250-cd6527a6e3eb could not be found. Jul 21 10:51:20.452544 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: action_args: {'id': '082cef74-9509-4b17-8250-cd6527a6e3eb'} Jul 21 10:51:20.453518 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 10:51:20.453518 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:51:20.453518 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 10:51:20.453518 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 10:51:20.453518 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 10:51:20.453518 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 10:51:20.453518 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 10:51:20.453518 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 10:51:20.453518 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 10:51:20.453518 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 10:51:20.453518 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 082cef74-9509-4b17-8250-cd6527a6e3eb could not be found. Jul 21 10:51:20.453518 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:51:20.453518 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:51:20.453518 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:51:20.453518 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:51:20.453518 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:51:20.453518 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:51:20.453518 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 10:51:20.453518 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 10:51:20.453518 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 10:51:20.455101 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 10:51:20.455101 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 10:51:20.455101 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 10:51:20.455101 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 10:51:20.455101 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 10:51:20.455101 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 10:51:20.455101 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 10:51:20.455101 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 082cef74-9509-4b17-8250-cd6527a6e3eb could not be found. Jul 21 10:51:20.455101 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:51:20.455101 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:51:20.455101 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:51:20.455101 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:51:20.455101 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:51:20.455101 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:51:20.455101 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 10:51:20.455101 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 10:51:20.455101 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 082cef74-9509-4b17-8250-cd6527a6e3eb could not be found. Jul 21 10:51:20.455101 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:51:20.457213 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-f2377ce6-503d-4f5e-a687-b413ad3a8562 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] Returning 404 to user: Instance 082cef74-9509-4b17-8250-cd6527a6e3eb could not be found. {{(pid=124868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 10:51:20.457213 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-f2377ce6-503d-4f5e-a687-b413ad3a8562 tempest-VolumesSnapshotTestJSON-1148368882 tempest-VolumesSnapshotTestJSON-1148368882-project] 10.222.0.48 "GET /compute/v2.1/servers/082cef74-9509-4b17-8250-cd6527a6e3eb" status: 404 len: 111 microversion: 2.1 time: 0.029569 Jul 21 10:51:20.457213 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 329/673] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:51:20 2022] GET /compute/v2.1/servers/082cef74-9509-4b17-8250-cd6527a6e3eb => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 10:51:25.859294 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-d3b604db-e7d4-40b0-a2f4-0313710473cf tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:51:25.859786 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-d3b604db-e7d4-40b0-a2f4-0313710473cf tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:51:25.866379 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d3b604db-e7d4-40b0-a2f4-0313710473cf tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:25.870340 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d3b604db-e7d4-40b0-a2f4-0313710473cf tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:25.870340 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d3b604db-e7d4-40b0-a2f4-0313710473cf tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:25.870340 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d3b604db-e7d4-40b0-a2f4-0313710473cf tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:25.870648 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:51:25.896997 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-d3b604db-e7d4-40b0-a2f4-0313710473cf tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d/os-volume_attachments/a0a9ba60-d84c-4c0e-be7b-734cae5ad94a" status: 200 len: 194 microversion: 2.20 time: 0.142997 Jul 21 10:51:25.897562 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 345/674] 10.222.0.48 () {60 vars in 1453 bytes} [Thu Jul 21 10:51:25 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d/os-volume_attachments/a0a9ba60-d84c-4c0e-be7b-734cae5ad94a => generated 194 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 10:51:25.960999 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-50dcb887-617a-46c6-80d4-2df75950f398 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:51:25.961513 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-50dcb887-617a-46c6-80d4-2df75950f398 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:51:25.968488 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-50dcb887-617a-46c6-80d4-2df75950f398 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:25.968936 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-50dcb887-617a-46c6-80d4-2df75950f398 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:25.969690 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-50dcb887-617a-46c6-80d4-2df75950f398 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:25.970141 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-50dcb887-617a-46c6-80d4-2df75950f398 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:26.051161 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.objects.instance [None req-50dcb887-617a-46c6-80d4-2df75950f398 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lazy-loading 'services' on Instance uuid 1e730525-7ce4-4a5a-8023-84cae6b1da3d {{(pid=124868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 10:51:26.293252 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-50dcb887-617a-46c6-80d4-2df75950f398 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "DELETE /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d/os-volume_attachments/a0a9ba60-d84c-4c0e-be7b-734cae5ad94a" status: 202 len: 0 microversion: 2.20 time: 0.336068 Jul 21 10:51:26.293768 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 330/675] 10.222.0.48 () {60 vars in 1456 bytes} [Thu Jul 21 10:51:25 2022] DELETE /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d/os-volume_attachments/a0a9ba60-d84c-4c0e-be7b-734cae5ad94a => generated 0 bytes in 338 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 21 10:51:26.302786 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-949c0da6-cd6d-4d50-9e68-6926ddfb039b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:51:26.303782 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-949c0da6-cd6d-4d50-9e68-6926ddfb039b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:51:26.310599 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-949c0da6-cd6d-4d50-9e68-6926ddfb039b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:26.311053 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-949c0da6-cd6d-4d50-9e68-6926ddfb039b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:26.311820 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-949c0da6-cd6d-4d50-9e68-6926ddfb039b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:26.312285 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-949c0da6-cd6d-4d50-9e68-6926ddfb039b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:26.341484 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-949c0da6-cd6d-4d50-9e68-6926ddfb039b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043209 Jul 21 10:51:26.342063 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 346/676] 10.222.0.48 () {60 vars in 1342 bytes} [Thu Jul 21 10:51:26 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 10:51:27.354880 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-8dff6e03-2b48-47c5-8795-97a1bd5f8fca tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:51:27.355952 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-8dff6e03-2b48-47c5-8795-97a1bd5f8fca tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:51:27.362495 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8dff6e03-2b48-47c5-8795-97a1bd5f8fca tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:27.362974 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8dff6e03-2b48-47c5-8795-97a1bd5f8fca tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:27.363731 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8dff6e03-2b48-47c5-8795-97a1bd5f8fca tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:27.364165 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8dff6e03-2b48-47c5-8795-97a1bd5f8fca tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:27.393659 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-8dff6e03-2b48-47c5-8795-97a1bd5f8fca tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044352 Jul 21 10:51:27.394209 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 331/677] 10.222.0.48 () {60 vars in 1342 bytes} [Thu Jul 21 10:51:27 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 21 10:51:28.405315 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-74369f2b-9a16-445c-8515-732dff1649f8 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:51:28.406240 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-74369f2b-9a16-445c-8515-732dff1649f8 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:51:28.408896 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_api:SELECT=28 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:51:28.414690 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-74369f2b-9a16-445c-8515-732dff1649f8 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:28.415133 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-74369f2b-9a16-445c-8515-732dff1649f8 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:28.415881 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-74369f2b-9a16-445c-8515-732dff1649f8 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:28.416341 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-74369f2b-9a16-445c-8515-732dff1649f8 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:28.444874 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-74369f2b-9a16-445c-8515-732dff1649f8 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043492 Jul 21 10:51:28.445418 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 347/678] 10.222.0.48 () {60 vars in 1342 bytes} [Thu Jul 21 10:51:28 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:51:28.502719 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-93bff99e-8234-4bca-a240-60ffe4f86501 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:51:28.503203 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-93bff99e-8234-4bca-a240-60ffe4f86501 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:51:28.509799 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-93bff99e-8234-4bca-a240-60ffe4f86501 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:28.510243 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-93bff99e-8234-4bca-a240-60ffe4f86501 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:28.511034 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-93bff99e-8234-4bca-a240-60ffe4f86501 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:28.511468 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-93bff99e-8234-4bca-a240-60ffe4f86501 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:28.536015 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-93bff99e-8234-4bca-a240-60ffe4f86501 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Going to try to terminate instance {{(pid=124868) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 10:51:28.848884 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-93bff99e-8234-4bca-a240-60ffe4f86501 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "DELETE /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 204 len: 0 microversion: 2.20 time: 0.349673 Jul 21 10:51:28.849448 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 332/679] 10.222.0.48 () {60 vars in 1279 bytes} [Thu Jul 21 10:51:28 2022] DELETE /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 21 10:51:28.857612 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-42001280-f19b-4763-b384-1684ba4f1c1d tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:51:28.861119 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-42001280-f19b-4763-b384-1684ba4f1c1d tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:51:28.864522 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-42001280-f19b-4763-b384-1684ba4f1c1d tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:28.865505 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-42001280-f19b-4763-b384-1684ba4f1c1d tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:28.866304 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-42001280-f19b-4763-b384-1684ba4f1c1d tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:28.866765 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-42001280-f19b-4763-b384-1684ba4f1c1d tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:28.998724 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-42001280-f19b-4763-b384-1684ba4f1c1d tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:51:29.007801 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-42001280-f19b-4763-b384-1684ba4f1c1d tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:51:29.009277 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-42001280-f19b-4763-b384-1684ba4f1c1d tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:51:29.010410 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-42001280-f19b-4763-b384-1684ba4f1c1d tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1723 microversion: 2.20 time: 0.156780 Jul 21 10:51:29.011007 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 348/680] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:51:28 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:51:30.029525 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-ca1b2731-68a9-4f52-9e92-c36f1a92f19b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:51:30.030212 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-ca1b2731-68a9-4f52-9e92-c36f1a92f19b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:51:30.036591 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ca1b2731-68a9-4f52-9e92-c36f1a92f19b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:30.037036 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ca1b2731-68a9-4f52-9e92-c36f1a92f19b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:30.038769 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ca1b2731-68a9-4f52-9e92-c36f1a92f19b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:30.039283 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ca1b2731-68a9-4f52-9e92-c36f1a92f19b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:30.046178 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:51:30.175463 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-ca1b2731-68a9-4f52-9e92-c36f1a92f19b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:51:30.184209 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-ca1b2731-68a9-4f52-9e92-c36f1a92f19b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:51:30.185720 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-ca1b2731-68a9-4f52-9e92-c36f1a92f19b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:51:30.186942 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-ca1b2731-68a9-4f52-9e92-c36f1a92f19b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1723 microversion: 2.20 time: 0.161670 Jul 21 10:51:30.187502 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 333/681] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:51:30 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:51:31.204996 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-0bb3495d-3927-43ac-8224-3e5ebd885d65 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:51:31.205732 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-0bb3495d-3927-43ac-8224-3e5ebd885d65 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:51:31.212926 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0bb3495d-3927-43ac-8224-3e5ebd885d65 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:31.213377 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0bb3495d-3927-43ac-8224-3e5ebd885d65 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:31.217291 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0bb3495d-3927-43ac-8224-3e5ebd885d65 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:31.217291 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0bb3495d-3927-43ac-8224-3e5ebd885d65 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:31.344181 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-0bb3495d-3927-43ac-8224-3e5ebd885d65 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:51:31.352877 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-0bb3495d-3927-43ac-8224-3e5ebd885d65 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:51:31.354371 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-0bb3495d-3927-43ac-8224-3e5ebd885d65 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:51:31.355579 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-0bb3495d-3927-43ac-8224-3e5ebd885d65 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1723 microversion: 2.20 time: 0.154452 Jul 21 10:51:31.356141 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 349/682] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:51:31 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:51:31.916085 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [req-9d3eb492-335d-47d8-a380-471c08127633 req-99740e0a-3e93-48bd-80de-a7654b938efb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e730525-7ce4-4a5a-8023-84cae6b1da3d", "name": "network-vif-deleted", "tag": "e0efd748-6569-4435-ab16-d9acccb72164"}]} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:51:31.924569 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-9d3eb492-335d-47d8-a380-471c08127633 req-99740e0a-3e93-48bd-80de-a7654b938efb service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:31.925002 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-9d3eb492-335d-47d8-a380-471c08127633 req-99740e0a-3e93-48bd-80de-a7654b938efb service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:31.937350 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.compute.server_external_events [req-9d3eb492-335d-47d8-a380-471c08127633 req-99740e0a-3e93-48bd-80de-a7654b938efb service nova] Creating event network-vif-deleted:e0efd748-6569-4435-ab16-d9acccb72164 for instance 1e730525-7ce4-4a5a-8023-84cae6b1da3d on hv-cinder-84980 Jul 21 10:51:31.942215 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [req-9d3eb492-335d-47d8-a380-471c08127633 req-99740e0a-3e93-48bd-80de-a7654b938efb service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031377 Jul 21 10:51:31.942850 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 334/683] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 21 10:51:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:51:32.373835 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-71c28467-21ee-40de-92e6-e1d2f39ff044 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:51:32.374792 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-71c28467-21ee-40de-92e6-e1d2f39ff044 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:51:32.393924 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-71c28467-21ee-40de-92e6-e1d2f39ff044 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:32.394374 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-71c28467-21ee-40de-92e6-e1d2f39ff044 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:32.397456 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-71c28467-21ee-40de-92e6-e1d2f39ff044 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:32.398927 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-71c28467-21ee-40de-92e6-e1d2f39ff044 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:32.435509 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-71c28467-21ee-40de-92e6-e1d2f39ff044 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:32.435958 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-71c28467-21ee-40de-92e6-e1d2f39ff044 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:32.436404 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.objects.instance [None req-71c28467-21ee-40de-92e6-e1d2f39ff044 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lazy-loading 'fault' on Instance uuid 1e730525-7ce4-4a5a-8023-84cae6b1da3d {{(pid=124867) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 10:51:32.486181 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-71c28467-21ee-40de-92e6-e1d2f39ff044 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:51:32.495180 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-71c28467-21ee-40de-92e6-e1d2f39ff044 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:51:32.496676 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-71c28467-21ee-40de-92e6-e1d2f39ff044 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:51:32.497819 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-71c28467-21ee-40de-92e6-e1d2f39ff044 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1371 microversion: 2.20 time: 0.128186 Jul 21 10:51:32.498368 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 350/684] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:51:32 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1371 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:51:33.516540 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-b66fa10b-cacb-4163-8ee7-902131585cbd tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:51:33.517221 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-b66fa10b-cacb-4163-8ee7-902131585cbd tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:51:33.524055 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b66fa10b-cacb-4163-8ee7-902131585cbd tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:33.524493 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b66fa10b-cacb-4163-8ee7-902131585cbd tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:33.525241 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b66fa10b-cacb-4163-8ee7-902131585cbd tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:33.525666 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b66fa10b-cacb-4163-8ee7-902131585cbd tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:33.556139 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b66fa10b-cacb-4163-8ee7-902131585cbd tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:33.556576 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b66fa10b-cacb-4163-8ee7-902131585cbd tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:33.557015 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.objects.instance [None req-b66fa10b-cacb-4163-8ee7-902131585cbd tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lazy-loading 'fault' on Instance uuid 1e730525-7ce4-4a5a-8023-84cae6b1da3d {{(pid=124868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 10:51:33.598051 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-b66fa10b-cacb-4163-8ee7-902131585cbd tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:51:33.605790 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-b66fa10b-cacb-4163-8ee7-902131585cbd tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:51:33.607311 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-b66fa10b-cacb-4163-8ee7-902131585cbd tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:51:33.608433 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-b66fa10b-cacb-4163-8ee7-902131585cbd tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1371 microversion: 2.20 time: 0.096505 Jul 21 10:51:33.608979 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 335/685] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:51:33 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1371 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:51:34.626846 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-23c22ca8-c84f-4797-9c95-1b2fa210a459 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:51:34.627448 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-23c22ca8-c84f-4797-9c95-1b2fa210a459 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:51:34.633743 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-23c22ca8-c84f-4797-9c95-1b2fa210a459 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:34.634211 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-23c22ca8-c84f-4797-9c95-1b2fa210a459 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:34.635059 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-23c22ca8-c84f-4797-9c95-1b2fa210a459 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:34.635489 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-23c22ca8-c84f-4797-9c95-1b2fa210a459 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:34.665718 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-23c22ca8-c84f-4797-9c95-1b2fa210a459 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:34.666158 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-23c22ca8-c84f-4797-9c95-1b2fa210a459 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:34.666631 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.objects.instance [None req-23c22ca8-c84f-4797-9c95-1b2fa210a459 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lazy-loading 'fault' on Instance uuid 1e730525-7ce4-4a5a-8023-84cae6b1da3d {{(pid=124867) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 10:51:34.706972 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-23c22ca8-c84f-4797-9c95-1b2fa210a459 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:51:34.715008 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-23c22ca8-c84f-4797-9c95-1b2fa210a459 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:51:34.716785 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-23c22ca8-c84f-4797-9c95-1b2fa210a459 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:51:34.717935 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-23c22ca8-c84f-4797-9c95-1b2fa210a459 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 200 len: 1371 microversion: 2.20 time: 0.094913 Jul 21 10:51:34.718481 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 351/686] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:51:34 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 1371 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:51:35.303862 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-61cf10a3-c806-4d7a-903e-401c24049668 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:51:35.304842 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-61cf10a3-c806-4d7a-903e-401c24049668 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] [instance: 6597f555-38e1-4d14-bf7c-6d8b5e5a26d4] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:51:35.311319 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-61cf10a3-c806-4d7a-903e-401c24049668 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:35.311760 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-61cf10a3-c806-4d7a-903e-401c24049668 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:35.312509 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-61cf10a3-c806-4d7a-903e-401c24049668 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:35.312934 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-61cf10a3-c806-4d7a-903e-401c24049668 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:35.504117 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-61cf10a3-c806-4d7a-903e-401c24049668 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] 10.222.0.48 "POST /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4/action" status: 202 len: 0 microversion: 2.1 time: 0.204534 Jul 21 10:51:35.504836 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 336/687] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 21 10:51:35 2022] POST /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4/action => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 10:51:35.513179 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-bb56e8d9-5335-42bf-bdcd-a2b86f4a7275 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:51:35.517925 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-bb56e8d9-5335-42bf-bdcd-a2b86f4a7275 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] [instance: 6597f555-38e1-4d14-bf7c-6d8b5e5a26d4] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:51:35.519755 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-bb56e8d9-5335-42bf-bdcd-a2b86f4a7275 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:35.520196 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-bb56e8d9-5335-42bf-bdcd-a2b86f4a7275 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:35.521014 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-bb56e8d9-5335-42bf-bdcd-a2b86f4a7275 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:35.521459 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-bb56e8d9-5335-42bf-bdcd-a2b86f4a7275 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:35.737048 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-ca978492-8719-4cf7-839a-bf0ffae09758 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:51:35.738068 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-ca978492-8719-4cf7-839a-bf0ffae09758 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:51:35.745473 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ca978492-8719-4cf7-839a-bf0ffae09758 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:35.745990 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ca978492-8719-4cf7-839a-bf0ffae09758 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:35.746839 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ca978492-8719-4cf7-839a-bf0ffae09758 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:35.747269 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ca978492-8719-4cf7-839a-bf0ffae09758 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:35.762421 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.wsgi [None req-ca978492-8719-4cf7-839a-bf0ffae09758 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] HTTP exception thrown: Instance 1e730525-7ce4-4a5a-8023-84cae6b1da3d could not be found. Jul 21 10:51:35.764131 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-ca978492-8719-4cf7-839a-bf0ffae09758 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Request method failure captured: Jul 21 10:51:35.764131 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: request: GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d HTTP/1.1 Jul 21 10:51:35.764131 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Accept: application/json Jul 21 10:51:35.764131 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Accept-Encoding: identity Jul 21 10:51:35.764131 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Connection: close Jul 21 10:51:35.764131 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Content-Length: 0 Jul 21 10:51:35.764131 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Content-Type: application/json Jul 21 10:51:35.764131 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Host: 10.222.0.48 Jul 21 10:51:35.764131 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Openstack-System-Scope: None Jul 21 10:51:35.764131 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: User-Agent: python-urllib3/1.26.9 Jul 21 10:51:35.764131 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Auth-Token: gAAAAABi2S6AAell6KnUKQJ3Lgu-3CQXwlXJQPgUDimqJdCH8j6KcSAoDWQyXvEJe0_atGC5pxRdTL4J2FORWXfIe4hdNevegn1welfv2n2eN9xTT3J5bH13TYDEfzY7soM01d6yrZE7vqG_CO_ZwO6uAl-F1pPUpF-cBO7OhNzzbDRpZN3MYPs Jul 21 10:51:35.764131 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Domain-Id: None Jul 21 10:51:35.764131 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Domain-Name: None Jul 21 10:51:35.764131 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Identity-Status: Confirmed Jul 21 10:51:35.764131 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Is-Admin-Project: True Jul 21 10:51:35.764131 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Openstack-Nova-Api-Version: 2.20 Jul 21 10:51:35.764131 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Domain-Id: default Jul 21 10:51:35.764131 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Domain-Name: Default Jul 21 10:51:35.764131 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Id: 29c1b9c9f7024f8494e0a9b58fe35710 Jul 21 10:51:35.764131 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-97716353 Jul 21 10:51:35.764131 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Role: reader,member Jul 21 10:51:35.764131 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Roles: reader,member Jul 21 10:51:35.765527 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/29c1b9c9f7024f8494e0a9b58fe35710"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/29c1b9c9f7024f8494e0a9b58fe35710"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/29c1b9c9f7024f8494e0a9b58fe35710"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_29c1b9c9f7024f8494e0a9b58fe35710"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] Jul 21 10:51:35.765527 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Tenant: tempest-AttachVolumeShelveTestJSON-97716353 Jul 21 10:51:35.765527 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Tenant-Id: 29c1b9c9f7024f8494e0a9b58fe35710 Jul 21 10:51:35.765527 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-97716353 Jul 21 10:51:35.765527 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User: tempest-AttachVolumeShelveTestJSON-97716353-project Jul 21 10:51:35.765527 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Domain-Id: default Jul 21 10:51:35.765527 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Domain-Name: Default Jul 21 10:51:35.765527 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Id: 23b63d44bb304e97a38acc6d0b791c95 Jul 21 10:51:35.765527 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Name: tempest-AttachVolumeShelveTestJSON-97716353-project Jul 21 10:51:35.765527 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: method: > Jul 21 10:51:35.765527 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: exception: Instance 1e730525-7ce4-4a5a-8023-84cae6b1da3d could not be found. Jul 21 10:51:35.765527 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: action_args: {'id': '1e730525-7ce4-4a5a-8023-84cae6b1da3d'} Jul 21 10:51:35.766359 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 10:51:35.766359 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:51:35.766359 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 10:51:35.766359 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 10:51:35.766359 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 10:51:35.766359 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 10:51:35.766359 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 10:51:35.766359 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 10:51:35.766359 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 10:51:35.766359 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 10:51:35.766359 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e730525-7ce4-4a5a-8023-84cae6b1da3d could not be found. Jul 21 10:51:35.766359 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:51:35.766359 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:51:35.766359 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:51:35.766359 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:51:35.766359 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:51:35.766359 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:51:35.766359 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 10:51:35.766359 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 10:51:35.766359 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 10:51:35.770176 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 10:51:35.770176 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 10:51:35.770176 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 10:51:35.770176 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 10:51:35.770176 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 10:51:35.770176 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 10:51:35.770176 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 10:51:35.770176 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e730525-7ce4-4a5a-8023-84cae6b1da3d could not be found. Jul 21 10:51:35.770176 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:51:35.770176 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:51:35.770176 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:51:35.770176 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:51:35.770176 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:51:35.770176 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:51:35.770176 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 10:51:35.770176 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 10:51:35.770176 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e730525-7ce4-4a5a-8023-84cae6b1da3d could not be found. Jul 21 10:51:35.770176 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:51:35.771275 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-ca978492-8719-4cf7-839a-bf0ffae09758 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Returning 404 to user: Instance 1e730525-7ce4-4a5a-8023-84cae6b1da3d could not be found. {{(pid=124868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 10:51:35.771275 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-ca978492-8719-4cf7-839a-bf0ffae09758 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 404 len: 111 microversion: 2.20 time: 0.032837 Jul 21 10:51:35.771275 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 337/688] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:51:35 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 21 10:51:35.775084 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-3b2ddbd0-244b-46ef-bac3-904d6277f0eb tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '.version_select at 0x7f796350de50>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:51:35.895115 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-3b2ddbd0-244b-46ef-bac3-904d6277f0eb tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-926267718" status: 204 len: 0 microversion: 2.20 time: 0.123958 Jul 21 10:51:35.895835 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 338/689] 10.222.0.48 () {60 vars in 1258 bytes} [Thu Jul 21 10:51:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-926267718 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 21 10:51:35.915101 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-bb56e8d9-5335-42bf-bdcd-a2b86f4a7275 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0271efe4b4e9592b29d9f124519b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eff05785bd84522ad637d8bed14563d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:51:35.923350 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-bb56e8d9-5335-42bf-bdcd-a2b86f4a7275 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] 10.222.0.48 "GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4" status: 200 len: 1751 microversion: 2.1 time: 0.413804 Jul 21 10:51:35.925951 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 352/690] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:51:35 2022] GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4 => generated 1751 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:51:36.905279 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-a8ab1c42-f69f-45eb-aec0-ec9264080932 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Action: 'create', calling method: .version_select at 0x7f7962a21790>, body: {"keypair": {"name": "tempest-keypair-871932054", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGMbNvEVQ7QwYXEpUfDZ/V5WZDxK/ASDzt2H6Y4I7TJBnRB1MqyFUhYCKtDetUPqOIq1lAwPmWel+Gvdox5JHQUzpkxhxF9WQku7pAe0BK7X6tqq+SUo7P3HCl4udn+IIQ=="}} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:51:36.920497 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.quota [None req-a8ab1c42-f69f-45eb-aec0-ec9264080932 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Getting quotas for project 29c1b9c9f7024f8494e0a9b58fe35710. Resources: {'key_pairs'} {{(pid=124868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 10:51:36.930718 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.quota [None req-a8ab1c42-f69f-45eb-aec0-ec9264080932 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Getting quotas for user 23b63d44bb304e97a38acc6d0b791c95 and project 29c1b9c9f7024f8494e0a9b58fe35710. Resources: {'key_pairs'} {{(pid=124868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 10:51:36.945881 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-0e1a9ee7-feac-4ab7-9f28-5db28cf6647d tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:51:36.946482 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-0e1a9ee7-feac-4ab7-9f28-5db28cf6647d tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] [instance: 6597f555-38e1-4d14-bf7c-6d8b5e5a26d4] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:51:36.953045 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0e1a9ee7-feac-4ab7-9f28-5db28cf6647d tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:36.953624 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0e1a9ee7-feac-4ab7-9f28-5db28cf6647d tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:36.954280 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0e1a9ee7-feac-4ab7-9f28-5db28cf6647d tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:36.954740 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0e1a9ee7-feac-4ab7-9f28-5db28cf6647d tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:37.038568 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-a8ab1c42-f69f-45eb-aec0-ec9264080932 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.140248 Jul 21 10:51:37.041234 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 339/691] 10.222.0.48 () {62 vars in 1199 bytes} [Thu Jul 21 10:51:36 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 142 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 21 10:51:37.105390 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-0e1a9ee7-feac-4ab7-9f28-5db28cf6647d tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0271efe4b4e9592b29d9f124519b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eff05785bd84522ad637d8bed14563d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:51:37.120349 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-0e1a9ee7-feac-4ab7-9f28-5db28cf6647d tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] 10.222.0.48 "GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4" status: 200 len: 1756 microversion: 2.1 time: 0.172672 Jul 21 10:51:37.120349 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 353/692] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:51:36 2022] GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4 => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:51:38.141723 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-fd247d33-1a54-4ce4-85ec-fc08bdd5f924 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:51:38.142337 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-fd247d33-1a54-4ce4-85ec-fc08bdd5f924 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] [instance: 6597f555-38e1-4d14-bf7c-6d8b5e5a26d4] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:51:38.148624 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-fd247d33-1a54-4ce4-85ec-fc08bdd5f924 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:38.149154 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-fd247d33-1a54-4ce4-85ec-fc08bdd5f924 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:38.149921 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-fd247d33-1a54-4ce4-85ec-fc08bdd5f924 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:38.150356 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-fd247d33-1a54-4ce4-85ec-fc08bdd5f924 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:38.395293 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-fd247d33-1a54-4ce4-85ec-fc08bdd5f924 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0271efe4b4e9592b29d9f124519b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eff05785bd84522ad637d8bed14563d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:51:38.403994 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-fd247d33-1a54-4ce4-85ec-fc08bdd5f924 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] 10.222.0.48 "GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4" status: 200 len: 1756 microversion: 2.1 time: 0.266610 Jul 21 10:51:38.404584 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 340/693] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:51:38 2022] GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4 => generated 1756 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:51:39.345951 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-96ceb442-5a27-4b08-aa2c-02ea2e6e6a96 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-109966329", "imageRef": "282ddb30-fa0f-489d-9cc3-a3e70e03c631", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c770f837-eda0-4a68-b0cf-fd07722be163"}], "security_groups": [{"name": "tempest-securitygroup--1460754056"}], "key_name": "tempest-keypair-871932054", "user_data": "}} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:51:39.421202 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-b26563ac-76f7-4364-877b-13441263922d tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:51:39.422118 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-b26563ac-76f7-4364-877b-13441263922d tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] [instance: 6597f555-38e1-4d14-bf7c-6d8b5e5a26d4] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:51:39.429223 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b26563ac-76f7-4364-877b-13441263922d tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:39.429674 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b26563ac-76f7-4364-877b-13441263922d tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:39.430447 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b26563ac-76f7-4364-877b-13441263922d tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:39.430909 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b26563ac-76f7-4364-877b-13441263922d tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:39.454499 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.network.neutron [None req-96ceb442-5a27-4b08-aa2c-02ea2e6e6a96 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] validate_networks() for [('c770f837-eda0-4a68-b0cf-fd07722be163', None, None, None, None, None)] {{(pid=124867) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 10:51:39.704600 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-b26563ac-76f7-4364-877b-13441263922d tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0271efe4b4e9592b29d9f124519b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eff05785bd84522ad637d8bed14563d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:51:39.713783 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-b26563ac-76f7-4364-877b-13441263922d tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] 10.222.0.48 "GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4" status: 200 len: 1756 microversion: 2.1 time: 0.296285 Jul 21 10:51:39.714362 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 341/694] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:51:39 2022] GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4 => generated 1756 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:51:40.116265 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-96ceb442-5a27-4b08-aa2c-02ea2e6e6a96 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Flavor limits 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 10:51:40.117001 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-96ceb442-5a27-4b08-aa2c-02ea2e6e6a96 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Image limits 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 10:51:40.117488 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-96ceb442-5a27-4b08-aa2c-02ea2e6e6a96 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Flavor pref 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 10:51:40.117905 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-96ceb442-5a27-4b08-aa2c-02ea2e6e6a96 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Image pref 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 10:51:40.118310 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-96ceb442-5a27-4b08-aa2c-02ea2e6e6a96 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 10:51:40.127390 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-96ceb442-5a27-4b08-aa2c-02ea2e6e6a96 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:40.128180 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-96ceb442-5a27-4b08-aa2c-02ea2e6e6a96 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:40.129012 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-96ceb442-5a27-4b08-aa2c-02ea2e6e6a96 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:40.129442 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-96ceb442-5a27-4b08-aa2c-02ea2e6e6a96 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:40.149288 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.quota [None req-96ceb442-5a27-4b08-aa2c-02ea2e6e6a96 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Getting quotas for project 29c1b9c9f7024f8494e0a9b58fe35710. Resources: {'ram', 'instances', 'cores'} {{(pid=124867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 10:51:40.153482 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.quota [None req-96ceb442-5a27-4b08-aa2c-02ea2e6e6a96 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Getting quotas for user 23b63d44bb304e97a38acc6d0b791c95 and project 29c1b9c9f7024f8494e0a9b58fe35710. Resources: {'ram', 'instances', 'cores'} {{(pid=124867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 10:51:40.164320 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-96ceb442-5a27-4b08-aa2c-02ea2e6e6a96 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Going to run 1 instances... {{(pid=124867) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 10:51:40.167177 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-96ceb442-5a27-4b08-aa2c-02ea2e6e6a96 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 68c9ec60-9f75-4491-a780-6c339cc6d445] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='282ddb30-fa0f-489d-9cc3-a3e70e03c631',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124867) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 10:51:40.290384 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-96ceb442-5a27-4b08-aa2c-02ea2e6e6a96 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.950119 Jul 21 10:51:40.291099 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 354/695] 10.222.0.48 () {62 vars in 1187 bytes} [Thu Jul 21 10:51:39 2022] POST /compute/v2.1/servers => generated 402 bytes in 951 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 21 10:51:40.301745 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-213c0c8d-dbbf-4d10-a6e4-a39fcf854d5a tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:51:40.302351 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-213c0c8d-dbbf-4d10-a6e4-a39fcf854d5a tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 68c9ec60-9f75-4491-a780-6c339cc6d445] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:51:40.358234 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-213c0c8d-dbbf-4d10-a6e4-a39fcf854d5a tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:51:40.365283 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-213c0c8d-dbbf-4d10-a6e4-a39fcf854d5a tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:51:40.366944 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-213c0c8d-dbbf-4d10-a6e4-a39fcf854d5a tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:51:40.368035 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-213c0c8d-dbbf-4d10-a6e4-a39fcf854d5a tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445" status: 200 len: 1280 microversion: 2.20 time: 0.070359 Jul 21 10:51:40.368586 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 342/696] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:51:40 2022] GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445 => generated 1280 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:51:40.735518 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-e6341267-4f1e-467d-b9cf-867410b571cc tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:51:40.736127 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-e6341267-4f1e-467d-b9cf-867410b571cc tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] [instance: 6597f555-38e1-4d14-bf7c-6d8b5e5a26d4] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:51:40.742208 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e6341267-4f1e-467d-b9cf-867410b571cc tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:40.742683 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e6341267-4f1e-467d-b9cf-867410b571cc tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:40.743441 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e6341267-4f1e-467d-b9cf-867410b571cc tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:40.743873 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e6341267-4f1e-467d-b9cf-867410b571cc tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:40.899440 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-e6341267-4f1e-467d-b9cf-867410b571cc tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0271efe4b4e9592b29d9f124519b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eff05785bd84522ad637d8bed14563d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:51:40.907442 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-e6341267-4f1e-467d-b9cf-867410b571cc tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] 10.222.0.48 "GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4" status: 200 len: 1756 microversion: 2.1 time: 0.176316 Jul 21 10:51:40.908004 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 355/697] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:51:40 2022] GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4 => generated 1756 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:51:41.385841 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-5c4dd472-fcad-4a4b-8811-2a88f548fdbd tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:51:41.386482 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-5c4dd472-fcad-4a4b-8811-2a88f548fdbd tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 68c9ec60-9f75-4491-a780-6c339cc6d445] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:51:41.393747 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5c4dd472-fcad-4a4b-8811-2a88f548fdbd tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:41.394194 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5c4dd472-fcad-4a4b-8811-2a88f548fdbd tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:41.395011 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5c4dd472-fcad-4a4b-8811-2a88f548fdbd tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:41.395450 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5c4dd472-fcad-4a4b-8811-2a88f548fdbd tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:41.457983 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-5c4dd472-fcad-4a4b-8811-2a88f548fdbd tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:51:41.467258 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-5c4dd472-fcad-4a4b-8811-2a88f548fdbd tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:51:41.468784 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-5c4dd472-fcad-4a4b-8811-2a88f548fdbd tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:51:41.469859 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-5c4dd472-fcad-4a4b-8811-2a88f548fdbd tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445" status: 200 len: 1276 microversion: 2.20 time: 0.088675 Jul 21 10:51:41.470437 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 343/698] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:51:41 2022] GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445 => generated 1276 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:51:41.924802 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-189d24de-f406-4022-a428-7347f2a4bd46 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:51:41.925419 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-189d24de-f406-4022-a428-7347f2a4bd46 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] [instance: 6597f555-38e1-4d14-bf7c-6d8b5e5a26d4] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:51:41.932158 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-189d24de-f406-4022-a428-7347f2a4bd46 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:41.932608 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-189d24de-f406-4022-a428-7347f2a4bd46 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:41.933377 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-189d24de-f406-4022-a428-7347f2a4bd46 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:41.933814 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-189d24de-f406-4022-a428-7347f2a4bd46 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:42.079393 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-189d24de-f406-4022-a428-7347f2a4bd46 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0271efe4b4e9592b29d9f124519b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eff05785bd84522ad637d8bed14563d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:51:42.088065 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-189d24de-f406-4022-a428-7347f2a4bd46 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] 10.222.0.48 "GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4" status: 200 len: 1756 microversion: 2.1 time: 0.167255 Jul 21 10:51:42.088795 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 356/699] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:51:41 2022] GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4 => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:51:42.487944 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-ae951f48-96ed-4b4f-bbe9-e8e5d4fa87ac tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:51:42.488557 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-ae951f48-96ed-4b4f-bbe9-e8e5d4fa87ac tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 68c9ec60-9f75-4491-a780-6c339cc6d445] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:51:42.496468 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ae951f48-96ed-4b4f-bbe9-e8e5d4fa87ac tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:42.496924 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ae951f48-96ed-4b4f-bbe9-e8e5d4fa87ac tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:42.497803 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ae951f48-96ed-4b4f-bbe9-e8e5d4fa87ac tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:42.498238 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ae951f48-96ed-4b4f-bbe9-e8e5d4fa87ac tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:42.562525 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-ae951f48-96ed-4b4f-bbe9-e8e5d4fa87ac tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:51:42.571389 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-ae951f48-96ed-4b4f-bbe9-e8e5d4fa87ac tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:51:42.572998 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-ae951f48-96ed-4b4f-bbe9-e8e5d4fa87ac tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:51:42.574085 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-ae951f48-96ed-4b4f-bbe9-e8e5d4fa87ac tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445" status: 200 len: 1350 microversion: 2.20 time: 0.090221 Jul 21 10:51:42.574662 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 344/700] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:51:42 2022] GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445 => generated 1350 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:51:43.106003 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-14068d48-2973-4b60-b21b-f61499327c2f tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:51:43.106636 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-14068d48-2973-4b60-b21b-f61499327c2f tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] [instance: 6597f555-38e1-4d14-bf7c-6d8b5e5a26d4] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:51:43.113615 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-14068d48-2973-4b60-b21b-f61499327c2f tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:43.114358 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-14068d48-2973-4b60-b21b-f61499327c2f tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:43.115086 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-14068d48-2973-4b60-b21b-f61499327c2f tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:43.115610 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-14068d48-2973-4b60-b21b-f61499327c2f tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:43.269130 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-14068d48-2973-4b60-b21b-f61499327c2f tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0271efe4b4e9592b29d9f124519b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eff05785bd84522ad637d8bed14563d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:51:43.279501 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-14068d48-2973-4b60-b21b-f61499327c2f tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] 10.222.0.48 "GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4" status: 200 len: 1756 microversion: 2.1 time: 0.177346 Jul 21 10:51:43.280255 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 357/701] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:51:43 2022] GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4 => generated 1756 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:51:43.592388 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-293320c4-39a8-4892-8893-ba6d24c27dce tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:51:43.596327 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-293320c4-39a8-4892-8893-ba6d24c27dce tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 68c9ec60-9f75-4491-a780-6c339cc6d445] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:51:43.599514 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-293320c4-39a8-4892-8893-ba6d24c27dce tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:43.600007 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-293320c4-39a8-4892-8893-ba6d24c27dce tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:43.601268 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-293320c4-39a8-4892-8893-ba6d24c27dce tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:43.601893 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-293320c4-39a8-4892-8893-ba6d24c27dce tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:43.748648 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-293320c4-39a8-4892-8893-ba6d24c27dce tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:51:43.758628 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-293320c4-39a8-4892-8893-ba6d24c27dce tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:51:43.760768 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-293320c4-39a8-4892-8893-ba6d24c27dce tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:51:43.762178 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-293320c4-39a8-4892-8893-ba6d24c27dce tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445" status: 200 len: 1406 microversion: 2.20 time: 0.174170 Jul 21 10:51:43.763248 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 345/702] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:51:43 2022] GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445 => generated 1406 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:51:43.943945 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [req-b53f44e2-a804-44f6-b9d1-983adc60cc66 req-e0fef872-e00b-4dab-bdb7-b5974e208990 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68c9ec60-9f75-4491-a780-6c339cc6d445", "tag": "767a932c-587b-4501-b928-eef9dd00de9e"}]} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:51:43.954504 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-b53f44e2-a804-44f6-b9d1-983adc60cc66 req-e0fef872-e00b-4dab-bdb7-b5974e208990 service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:43.955674 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-b53f44e2-a804-44f6-b9d1-983adc60cc66 req-e0fef872-e00b-4dab-bdb7-b5974e208990 service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:43.967590 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.compute.server_external_events [req-b53f44e2-a804-44f6-b9d1-983adc60cc66 req-e0fef872-e00b-4dab-bdb7-b5974e208990 service nova] Creating event network-changed:767a932c-587b-4501-b928-eef9dd00de9e for instance 68c9ec60-9f75-4491-a780-6c339cc6d445 on hv-cinder-84980 Jul 21 10:51:43.976834 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [req-b53f44e2-a804-44f6-b9d1-983adc60cc66 req-e0fef872-e00b-4dab-bdb7-b5974e208990 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032544 Jul 21 10:51:43.976834 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 358/703] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 21 10:51:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:51:44.298004 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-382a8ee3-8aff-4b74-bb84-8241bda2697b tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:51:44.298519 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-382a8ee3-8aff-4b74-bb84-8241bda2697b tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] [instance: 6597f555-38e1-4d14-bf7c-6d8b5e5a26d4] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:51:44.305987 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-382a8ee3-8aff-4b74-bb84-8241bda2697b tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:44.306428 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-382a8ee3-8aff-4b74-bb84-8241bda2697b tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:44.307221 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-382a8ee3-8aff-4b74-bb84-8241bda2697b tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:44.307646 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-382a8ee3-8aff-4b74-bb84-8241bda2697b tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:44.463904 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-382a8ee3-8aff-4b74-bb84-8241bda2697b tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0271efe4b4e9592b29d9f124519b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eff05785bd84522ad637d8bed14563d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:51:44.472561 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-382a8ee3-8aff-4b74-bb84-8241bda2697b tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] 10.222.0.48 "GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4" status: 200 len: 1756 microversion: 2.1 time: 0.178996 Jul 21 10:51:44.473128 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 346/704] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:51:44 2022] GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4 => generated 1756 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:51:44.781730 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-7a556257-36c1-412b-aca7-fb004b714fcb tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:51:44.782473 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-7a556257-36c1-412b-aca7-fb004b714fcb tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 68c9ec60-9f75-4491-a780-6c339cc6d445] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:51:44.789485 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7a556257-36c1-412b-aca7-fb004b714fcb tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:44.789936 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7a556257-36c1-412b-aca7-fb004b714fcb tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:44.790726 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7a556257-36c1-412b-aca7-fb004b714fcb tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:44.791156 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7a556257-36c1-412b-aca7-fb004b714fcb tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:44.932140 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-7a556257-36c1-412b-aca7-fb004b714fcb tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:51:44.940092 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-7a556257-36c1-412b-aca7-fb004b714fcb tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:51:44.952450 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-7a556257-36c1-412b-aca7-fb004b714fcb tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:51:44.952450 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-7a556257-36c1-412b-aca7-fb004b714fcb tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445" status: 200 len: 1406 microversion: 2.20 time: 0.166006 Jul 21 10:51:44.952450 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 359/705] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:51:44 2022] GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445 => generated 1406 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:51:45.490376 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-c3d63ff4-2678-4480-98aa-b42cb8eaa55e tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:51:45.491016 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-c3d63ff4-2678-4480-98aa-b42cb8eaa55e tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] [instance: 6597f555-38e1-4d14-bf7c-6d8b5e5a26d4] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:51:45.498017 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c3d63ff4-2678-4480-98aa-b42cb8eaa55e tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:45.498460 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c3d63ff4-2678-4480-98aa-b42cb8eaa55e tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:45.499248 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c3d63ff4-2678-4480-98aa-b42cb8eaa55e tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:45.499717 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c3d63ff4-2678-4480-98aa-b42cb8eaa55e tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:45.645132 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-c3d63ff4-2678-4480-98aa-b42cb8eaa55e tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0271efe4b4e9592b29d9f124519b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eff05785bd84522ad637d8bed14563d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:51:45.654085 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-c3d63ff4-2678-4480-98aa-b42cb8eaa55e tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] 10.222.0.48 "GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4" status: 200 len: 1756 microversion: 2.1 time: 0.167678 Jul 21 10:51:45.654662 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 347/706] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:51:45 2022] GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4 => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:51:45.961070 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-48ac3426-f6b6-4521-98e7-8cd6a01cc5cc tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:51:45.962443 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-48ac3426-f6b6-4521-98e7-8cd6a01cc5cc tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 68c9ec60-9f75-4491-a780-6c339cc6d445] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:51:45.969358 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-48ac3426-f6b6-4521-98e7-8cd6a01cc5cc tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:45.969811 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-48ac3426-f6b6-4521-98e7-8cd6a01cc5cc tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:45.970606 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-48ac3426-f6b6-4521-98e7-8cd6a01cc5cc tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:45.971048 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-48ac3426-f6b6-4521-98e7-8cd6a01cc5cc tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:46.104188 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-48ac3426-f6b6-4521-98e7-8cd6a01cc5cc tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:51:46.112203 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-48ac3426-f6b6-4521-98e7-8cd6a01cc5cc tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:51:46.113691 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-48ac3426-f6b6-4521-98e7-8cd6a01cc5cc tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:51:46.114879 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-48ac3426-f6b6-4521-98e7-8cd6a01cc5cc tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445" status: 200 len: 1406 microversion: 2.20 time: 0.157710 Jul 21 10:51:46.115432 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 360/707] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:51:45 2022] GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445 => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:51:46.672566 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-b94e350e-4756-4a19-a574-3787645742a0 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:51:46.673225 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-b94e350e-4756-4a19-a574-3787645742a0 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] [instance: 6597f555-38e1-4d14-bf7c-6d8b5e5a26d4] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:51:46.675669 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:51:46.681000 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b94e350e-4756-4a19-a574-3787645742a0 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:46.681445 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b94e350e-4756-4a19-a574-3787645742a0 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:46.682201 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b94e350e-4756-4a19-a574-3787645742a0 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:46.682668 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b94e350e-4756-4a19-a574-3787645742a0 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:46.827171 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-b94e350e-4756-4a19-a574-3787645742a0 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0271efe4b4e9592b29d9f124519b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eff05785bd84522ad637d8bed14563d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:51:46.834853 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-b94e350e-4756-4a19-a574-3787645742a0 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] 10.222.0.48 "GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4" status: 200 len: 1756 microversion: 2.1 time: 0.166306 Jul 21 10:51:46.836590 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 348/708] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:51:46 2022] GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4 => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:51:47.133941 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-691c9bc5-b54d-4f1b-80af-d0c4dba27d46 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:51:47.134591 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-691c9bc5-b54d-4f1b-80af-d0c4dba27d46 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 68c9ec60-9f75-4491-a780-6c339cc6d445] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:51:47.140939 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-691c9bc5-b54d-4f1b-80af-d0c4dba27d46 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:47.141387 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-691c9bc5-b54d-4f1b-80af-d0c4dba27d46 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:47.142144 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-691c9bc5-b54d-4f1b-80af-d0c4dba27d46 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:47.142600 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-691c9bc5-b54d-4f1b-80af-d0c4dba27d46 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:47.278152 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-691c9bc5-b54d-4f1b-80af-d0c4dba27d46 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:51:47.286834 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-691c9bc5-b54d-4f1b-80af-d0c4dba27d46 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:51:47.288520 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-691c9bc5-b54d-4f1b-80af-d0c4dba27d46 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:51:47.290017 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-691c9bc5-b54d-4f1b-80af-d0c4dba27d46 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445" status: 200 len: 1406 microversion: 2.20 time: 0.160634 Jul 21 10:51:47.291000 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 361/709] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:51:47 2022] GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445 => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:51:47.853693 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-907d7855-65f2-4dc9-8ad0-9f1aa18504ed tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:51:47.854295 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-907d7855-65f2-4dc9-8ad0-9f1aa18504ed tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] [instance: 6597f555-38e1-4d14-bf7c-6d8b5e5a26d4] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:51:47.862702 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-907d7855-65f2-4dc9-8ad0-9f1aa18504ed tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:47.865186 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-907d7855-65f2-4dc9-8ad0-9f1aa18504ed tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:47.865186 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-907d7855-65f2-4dc9-8ad0-9f1aa18504ed tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:47.865662 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-907d7855-65f2-4dc9-8ad0-9f1aa18504ed tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:48.019780 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-907d7855-65f2-4dc9-8ad0-9f1aa18504ed tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0271efe4b4e9592b29d9f124519b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eff05785bd84522ad637d8bed14563d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:51:48.029986 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-907d7855-65f2-4dc9-8ad0-9f1aa18504ed tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] 10.222.0.48 "GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4" status: 200 len: 1756 microversion: 2.1 time: 0.180686 Jul 21 10:51:48.031264 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 349/710] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:51:47 2022] GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4 => generated 1756 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:51:48.308944 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-608c8988-f827-4f6c-9d8c-a043cd7acfc0 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:51:48.309550 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-608c8988-f827-4f6c-9d8c-a043cd7acfc0 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 68c9ec60-9f75-4491-a780-6c339cc6d445] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:51:48.316000 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-608c8988-f827-4f6c-9d8c-a043cd7acfc0 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:48.317157 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-608c8988-f827-4f6c-9d8c-a043cd7acfc0 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:48.317298 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-608c8988-f827-4f6c-9d8c-a043cd7acfc0 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:48.317623 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-608c8988-f827-4f6c-9d8c-a043cd7acfc0 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:48.333157 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell1:SELECT=100 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:51:48.515148 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-608c8988-f827-4f6c-9d8c-a043cd7acfc0 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:51:48.523900 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-608c8988-f827-4f6c-9d8c-a043cd7acfc0 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:51:48.525355 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-608c8988-f827-4f6c-9d8c-a043cd7acfc0 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:51:48.526454 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-608c8988-f827-4f6c-9d8c-a043cd7acfc0 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445" status: 200 len: 1406 microversion: 2.20 time: 0.222482 Jul 21 10:51:48.527064 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 362/711] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:51:48 2022] GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445 => generated 1406 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:51:49.048881 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-c5469ee0-b019-40e4-a506-a8cbc84392cd tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:51:49.049488 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-c5469ee0-b019-40e4-a506-a8cbc84392cd tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] [instance: 6597f555-38e1-4d14-bf7c-6d8b5e5a26d4] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:51:49.056824 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c5469ee0-b019-40e4-a506-a8cbc84392cd tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:49.057280 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c5469ee0-b019-40e4-a506-a8cbc84392cd tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:49.058066 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c5469ee0-b019-40e4-a506-a8cbc84392cd tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:49.058507 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c5469ee0-b019-40e4-a506-a8cbc84392cd tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:49.210689 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-c5469ee0-b019-40e4-a506-a8cbc84392cd tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0271efe4b4e9592b29d9f124519b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eff05785bd84522ad637d8bed14563d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:51:49.219064 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-c5469ee0-b019-40e4-a506-a8cbc84392cd tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] 10.222.0.48 "GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4" status: 200 len: 1759 microversion: 2.1 time: 0.174221 Jul 21 10:51:49.219631 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 350/712] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:51:49 2022] GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4 => generated 1759 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:51:49.544633 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-c2495c4f-f0e2-4c17-a974-1e3865cfada3 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:51:49.545233 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-c2495c4f-f0e2-4c17-a974-1e3865cfada3 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 68c9ec60-9f75-4491-a780-6c339cc6d445] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:51:49.551616 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c2495c4f-f0e2-4c17-a974-1e3865cfada3 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:49.552053 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c2495c4f-f0e2-4c17-a974-1e3865cfada3 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:49.552794 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c2495c4f-f0e2-4c17-a974-1e3865cfada3 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:49.553222 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c2495c4f-f0e2-4c17-a974-1e3865cfada3 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:49.681306 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-c2495c4f-f0e2-4c17-a974-1e3865cfada3 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:51:49.689354 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-c2495c4f-f0e2-4c17-a974-1e3865cfada3 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:51:49.690862 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-c2495c4f-f0e2-4c17-a974-1e3865cfada3 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:51:49.691939 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-c2495c4f-f0e2-4c17-a974-1e3865cfada3 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445" status: 200 len: 1406 microversion: 2.20 time: 0.151228 Jul 21 10:51:49.692488 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 363/713] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:51:49 2022] GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445 => generated 1406 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:51:50.190029 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [req-2c15e25c-a29a-4b5a-bdb5-df643d62082c req-920f6c0c-259c-485e-9a93-ec16afb99a83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68c9ec60-9f75-4491-a780-6c339cc6d445", "name": "network-vif-plugged", "status": "completed", "tag": "767a932c-587b-4501-b928-eef9dd00de9e"}]} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:51:50.199736 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-2c15e25c-a29a-4b5a-bdb5-df643d62082c req-920f6c0c-259c-485e-9a93-ec16afb99a83 service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:50.200177 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-2c15e25c-a29a-4b5a-bdb5-df643d62082c req-920f6c0c-259c-485e-9a93-ec16afb99a83 service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:50.210724 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.compute.server_external_events [req-2c15e25c-a29a-4b5a-bdb5-df643d62082c req-920f6c0c-259c-485e-9a93-ec16afb99a83 service nova] Creating event network-vif-plugged:767a932c-587b-4501-b928-eef9dd00de9e for instance 68c9ec60-9f75-4491-a780-6c339cc6d445 on hv-cinder-84980 Jul 21 10:51:50.215864 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [req-2c15e25c-a29a-4b5a-bdb5-df643d62082c req-920f6c0c-259c-485e-9a93-ec16afb99a83 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029200 Jul 21 10:51:50.216451 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 351/714] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 21 10:51:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:51:50.709558 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-e0ac4bed-988a-4c21-9453-e9c3357640d6 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:51:50.710733 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-e0ac4bed-988a-4c21-9453-e9c3357640d6 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 68c9ec60-9f75-4491-a780-6c339cc6d445] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:51:50.712609 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell0:SELECT=2 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:51:50.713287 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell0:SELECT=6 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:51:50.718811 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e0ac4bed-988a-4c21-9453-e9c3357640d6 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:50.719265 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e0ac4bed-988a-4c21-9453-e9c3357640d6 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:50.720026 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e0ac4bed-988a-4c21-9453-e9c3357640d6 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:50.720463 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e0ac4bed-988a-4c21-9453-e9c3357640d6 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:50.851602 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-e0ac4bed-988a-4c21-9453-e9c3357640d6 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:51:50.859719 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-e0ac4bed-988a-4c21-9453-e9c3357640d6 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:51:50.861222 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-e0ac4bed-988a-4c21-9453-e9c3357640d6 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:51:50.864828 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-e0ac4bed-988a-4c21-9453-e9c3357640d6 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445" status: 200 len: 1406 microversion: 2.20 time: 0.156700 Jul 21 10:51:50.864828 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 364/715] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:51:50 2022] GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:51:51.310564 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell0:SELECT=6 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:51:51.315207 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-0c67b7e7-8016-4f53-82e8-54720a165af0 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:51:51.318768 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-0c67b7e7-8016-4f53-82e8-54720a165af0 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: a54643be-3f53-4fe5-bab0-786b71d627bb] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:51:51.322234 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0c67b7e7-8016-4f53-82e8-54720a165af0 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:51.322708 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0c67b7e7-8016-4f53-82e8-54720a165af0 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:51.323469 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0c67b7e7-8016-4f53-82e8-54720a165af0 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:51.323904 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0c67b7e7-8016-4f53-82e8-54720a165af0 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:51.406115 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.objects.instance [None req-0c67b7e7-8016-4f53-82e8-54720a165af0 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lazy-loading 'services' on Instance uuid a54643be-3f53-4fe5-bab0-786b71d627bb {{(pid=124868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 10:51:51.547949 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:51:51.624130 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-0c67b7e7-8016-4f53-82e8-54720a165af0 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "DELETE /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb/os-volume_attachments/14daff22-cc81-4f39-a09e-4f34e374cfa0" status: 202 len: 0 microversion: 2.1 time: 0.314268 Jul 21 10:51:51.625446 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 352/716] 10.222.0.48 () {58 vars in 1415 bytes} [Thu Jul 21 10:51:51 2022] DELETE /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb/os-volume_attachments/14daff22-cc81-4f39-a09e-4f34e374cfa0 => generated 0 bytes in 316 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 21 10:51:51.633162 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-6a678a8e-43b3-4ffd-bdc6-6614c102e13d tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:51:51.634003 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-6a678a8e-43b3-4ffd-bdc6-6614c102e13d tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: a54643be-3f53-4fe5-bab0-786b71d627bb] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:51:51.640001 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6a678a8e-43b3-4ffd-bdc6-6614c102e13d tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:51.640447 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6a678a8e-43b3-4ffd-bdc6-6614c102e13d tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:51.641203 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6a678a8e-43b3-4ffd-bdc6-6614c102e13d tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:51.641637 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6a678a8e-43b3-4ffd-bdc6-6614c102e13d tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:51.672196 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-6a678a8e-43b3-4ffd-bdc6-6614c102e13d tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042942 Jul 21 10:51:51.673104 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 365/717] 10.222.0.48 () {58 vars in 1301 bytes} [Thu Jul 21 10:51:51 2022] GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 10:51:51.880744 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-940aef10-4c86-4681-9086-de34238fe366 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:51:51.881428 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-940aef10-4c86-4681-9086-de34238fe366 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 68c9ec60-9f75-4491-a780-6c339cc6d445] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:51:51.888445 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-940aef10-4c86-4681-9086-de34238fe366 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:51.888819 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-940aef10-4c86-4681-9086-de34238fe366 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:51.889577 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-940aef10-4c86-4681-9086-de34238fe366 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:51.890003 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-940aef10-4c86-4681-9086-de34238fe366 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:52.021341 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-940aef10-4c86-4681-9086-de34238fe366 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:51:52.029718 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-940aef10-4c86-4681-9086-de34238fe366 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:51:52.031261 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-940aef10-4c86-4681-9086-de34238fe366 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:51:52.032343 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-940aef10-4c86-4681-9086-de34238fe366 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445" status: 200 len: 1406 microversion: 2.20 time: 0.155861 Jul 21 10:51:52.033088 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 353/718] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:51:51 2022] GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445 => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:51:52.684052 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-ef2570d5-3135-4c47-aeda-e601e9fb0e5e tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:51:52.684997 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-ef2570d5-3135-4c47-aeda-e601e9fb0e5e tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: a54643be-3f53-4fe5-bab0-786b71d627bb] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:51:52.691447 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ef2570d5-3135-4c47-aeda-e601e9fb0e5e tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:52.691908 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ef2570d5-3135-4c47-aeda-e601e9fb0e5e tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:52.692633 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ef2570d5-3135-4c47-aeda-e601e9fb0e5e tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:52.693090 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ef2570d5-3135-4c47-aeda-e601e9fb0e5e tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:52.722757 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-ef2570d5-3135-4c47-aeda-e601e9fb0e5e tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042592 Jul 21 10:51:52.723306 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 366/719] 10.222.0.48 () {58 vars in 1301 bytes} [Thu Jul 21 10:51:52 2022] GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:51:53.049857 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-42f9b054-dc80-4d23-a8b9-6b4261431706 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:51:53.050463 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-42f9b054-dc80-4d23-a8b9-6b4261431706 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 68c9ec60-9f75-4491-a780-6c339cc6d445] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:51:53.058022 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-42f9b054-dc80-4d23-a8b9-6b4261431706 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:53.058471 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-42f9b054-dc80-4d23-a8b9-6b4261431706 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:53.059269 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-42f9b054-dc80-4d23-a8b9-6b4261431706 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:53.059707 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-42f9b054-dc80-4d23-a8b9-6b4261431706 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:53.195315 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-42f9b054-dc80-4d23-a8b9-6b4261431706 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:51:53.203542 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-42f9b054-dc80-4d23-a8b9-6b4261431706 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:51:53.205044 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-42f9b054-dc80-4d23-a8b9-6b4261431706 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:51:53.206171 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-42f9b054-dc80-4d23-a8b9-6b4261431706 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445" status: 200 len: 1597 microversion: 2.20 time: 0.160198 Jul 21 10:51:53.206755 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 354/720] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:51:53 2022] GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445 => generated 1597 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:51:53.224596 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-254a7205-179c-42b3-a197-497a09355119 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:51:53.225083 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-254a7205-179c-42b3-a197-497a09355119 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 68c9ec60-9f75-4491-a780-6c339cc6d445] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:51:53.231806 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-254a7205-179c-42b3-a197-497a09355119 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:53.232245 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-254a7205-179c-42b3-a197-497a09355119 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:53.232994 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-254a7205-179c-42b3-a197-497a09355119 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:53.233425 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-254a7205-179c-42b3-a197-497a09355119 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:53.313405 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-254a7205-179c-42b3-a197-497a09355119 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.092578 Jul 21 10:51:53.314001 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 367/721] 10.222.0.48 () {60 vars in 1315 bytes} [Thu Jul 21 10:51:53 2022] GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 10:51:53.734519 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-e9b2f1df-16f4-46dd-900f-d67edc38b2ef tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:51:53.735570 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-e9b2f1df-16f4-46dd-900f-d67edc38b2ef tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: a54643be-3f53-4fe5-bab0-786b71d627bb] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:51:53.741478 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e9b2f1df-16f4-46dd-900f-d67edc38b2ef tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:53.742499 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e9b2f1df-16f4-46dd-900f-d67edc38b2ef tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:53.743360 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e9b2f1df-16f4-46dd-900f-d67edc38b2ef tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:53.743795 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e9b2f1df-16f4-46dd-900f-d67edc38b2ef tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:53.772425 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-e9b2f1df-16f4-46dd-900f-d67edc38b2ef tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041814 Jul 21 10:51:53.772987 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 355/722] 10.222.0.48 () {58 vars in 1301 bytes} [Thu Jul 21 10:51:53 2022] GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 21 10:51:53.855378 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-deb1f451-d5c6-45e5-a83b-d4cde70ca5b6 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:51:53.856071 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-deb1f451-d5c6-45e5-a83b-d4cde70ca5b6 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: a54643be-3f53-4fe5-bab0-786b71d627bb] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:51:53.862133 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-deb1f451-d5c6-45e5-a83b-d4cde70ca5b6 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:53.867388 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-deb1f451-d5c6-45e5-a83b-d4cde70ca5b6 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:53.867388 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-deb1f451-d5c6-45e5-a83b-d4cde70ca5b6 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:53.867388 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-deb1f451-d5c6-45e5-a83b-d4cde70ca5b6 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:53.896714 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-deb1f451-d5c6-45e5-a83b-d4cde70ca5b6 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: a54643be-3f53-4fe5-bab0-786b71d627bb] Going to try to terminate instance {{(pid=124867) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 10:51:54.185254 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-deb1f451-d5c6-45e5-a83b-d4cde70ca5b6 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "DELETE /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb" status: 204 len: 0 microversion: 2.1 time: 0.334277 Jul 21 10:51:54.185866 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 368/723] 10.222.0.48 () {58 vars in 1238 bytes} [Thu Jul 21 10:51:53 2022] DELETE /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 10:51:54.193798 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-df4253c1-224f-4ded-a7f8-235222cdcf86 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:51:54.194432 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-df4253c1-224f-4ded-a7f8-235222cdcf86 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: a54643be-3f53-4fe5-bab0-786b71d627bb] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:51:54.201499 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-df4253c1-224f-4ded-a7f8-235222cdcf86 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:54.201946 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-df4253c1-224f-4ded-a7f8-235222cdcf86 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:54.202771 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-df4253c1-224f-4ded-a7f8-235222cdcf86 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:54.203205 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-df4253c1-224f-4ded-a7f8-235222cdcf86 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:54.348149 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-df4253c1-224f-4ded-a7f8-235222cdcf86 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:51:54.356841 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-df4253c1-224f-4ded-a7f8-235222cdcf86 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb" status: 200 len: 1690 microversion: 2.1 time: 0.166738 Jul 21 10:51:54.357417 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 356/724] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:51:54 2022] GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb => generated 1690 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:51:54.475761 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [req-42d06c15-866a-4300-9ed2-9536ed41636f req-daf71e47-7d4b-4ea1-8c09-85bcfd5cba8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68c9ec60-9f75-4491-a780-6c339cc6d445", "tag": "767a932c-587b-4501-b928-eef9dd00de9e"}]} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:51:54.484575 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-42d06c15-866a-4300-9ed2-9536ed41636f req-daf71e47-7d4b-4ea1-8c09-85bcfd5cba8f service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:54.485018 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-42d06c15-866a-4300-9ed2-9536ed41636f req-daf71e47-7d4b-4ea1-8c09-85bcfd5cba8f service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:54.496438 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.compute.server_external_events [req-42d06c15-866a-4300-9ed2-9536ed41636f req-daf71e47-7d4b-4ea1-8c09-85bcfd5cba8f service nova] Creating event network-changed:767a932c-587b-4501-b928-eef9dd00de9e for instance 68c9ec60-9f75-4491-a780-6c339cc6d445 on hv-cinder-84980 Jul 21 10:51:54.502579 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [req-42d06c15-866a-4300-9ed2-9536ed41636f req-daf71e47-7d4b-4ea1-8c09-85bcfd5cba8f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.183359 Jul 21 10:51:54.502579 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 369/725] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 21 10:51:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 10:51:55.374291 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-0c382078-8724-442b-a0d0-b8d67da02d46 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:51:55.374924 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-0c382078-8724-442b-a0d0-b8d67da02d46 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: a54643be-3f53-4fe5-bab0-786b71d627bb] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:51:55.381642 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0c382078-8724-442b-a0d0-b8d67da02d46 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:55.382101 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0c382078-8724-442b-a0d0-b8d67da02d46 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:55.383735 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0c382078-8724-442b-a0d0-b8d67da02d46 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:55.384187 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0c382078-8724-442b-a0d0-b8d67da02d46 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:55.521411 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-0c382078-8724-442b-a0d0-b8d67da02d46 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:51:55.527311 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-0c382078-8724-442b-a0d0-b8d67da02d46 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb" status: 200 len: 1690 microversion: 2.1 time: 0.156846 Jul 21 10:51:55.527881 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 357/726] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:51:55 2022] GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb => generated 1690 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:51:55.645528 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-3559492a-69d1-47e7-a747-b6cd55352b6f tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:51:55.646116 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-3559492a-69d1-47e7-a747-b6cd55352b6f tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 6803db4b-7556-4e4e-989c-adfa3d140a09] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:51:55.652360 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3559492a-69d1-47e7-a747-b6cd55352b6f tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:55.652812 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3559492a-69d1-47e7-a747-b6cd55352b6f tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:55.653576 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3559492a-69d1-47e7-a747-b6cd55352b6f tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:55.654016 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3559492a-69d1-47e7-a747-b6cd55352b6f tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:55.676604 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-3559492a-69d1-47e7-a747-b6cd55352b6f tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/6803db4b-7556-4e4e-989c-adfa3d140a09/ips" status: 200 len: 149 microversion: 2.1 time: 0.133925 Jul 21 10:51:55.677151 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 370/727] 10.222.0.48 () {58 vars in 1247 bytes} [Thu Jul 21 10:51:55 2022] GET /compute/v2.1/servers/6803db4b-7556-4e4e-989c-adfa3d140a09/ips => generated 149 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:51:56.544793 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-21d52d2d-e590-4a65-a43b-47b12c2999c4 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:51:56.545395 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-21d52d2d-e590-4a65-a43b-47b12c2999c4 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: a54643be-3f53-4fe5-bab0-786b71d627bb] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:51:56.551742 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-21d52d2d-e590-4a65-a43b-47b12c2999c4 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:56.552192 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-21d52d2d-e590-4a65-a43b-47b12c2999c4 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:56.552943 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-21d52d2d-e590-4a65-a43b-47b12c2999c4 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:56.553380 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-21d52d2d-e590-4a65-a43b-47b12c2999c4 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:56.684732 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-21d52d2d-e590-4a65-a43b-47b12c2999c4 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:51:56.692193 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-21d52d2d-e590-4a65-a43b-47b12c2999c4 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb" status: 200 len: 1690 microversion: 2.1 time: 0.151995 Jul 21 10:51:56.692766 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 358/728] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:51:56 2022] GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb => generated 1690 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:51:57.241652 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-a508366f-3512-453c-b508-5f615498c92b tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "be4a3207-0c47-4fee-b1da-ac656ea7c482"}} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:51:57.242720 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-a508366f-3512-453c-b508-5f615498c92b tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 6803db4b-7556-4e4e-989c-adfa3d140a09] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:51:57.249257 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a508366f-3512-453c-b508-5f615498c92b tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:57.249698 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a508366f-3512-453c-b508-5f615498c92b tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:57.250445 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a508366f-3512-453c-b508-5f615498c92b tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:57.250906 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a508366f-3512-453c-b508-5f615498c92b tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:57.709175 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-ec2338de-d823-4eb2-88d4-3bd5f328dc9b tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:51:57.709775 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-ec2338de-d823-4eb2-88d4-3bd5f328dc9b tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: a54643be-3f53-4fe5-bab0-786b71d627bb] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:51:57.717217 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ec2338de-d823-4eb2-88d4-3bd5f328dc9b tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:57.717658 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ec2338de-d823-4eb2-88d4-3bd5f328dc9b tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:57.718409 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ec2338de-d823-4eb2-88d4-3bd5f328dc9b tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:57.718865 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ec2338de-d823-4eb2-88d4-3bd5f328dc9b tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:57.854335 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-ec2338de-d823-4eb2-88d4-3bd5f328dc9b tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:51:57.862234 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-ec2338de-d823-4eb2-88d4-3bd5f328dc9b tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb" status: 200 len: 1690 microversion: 2.1 time: 0.156826 Jul 21 10:51:57.862952 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 359/729] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:51:57 2022] GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb => generated 1690 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:51:58.389724 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-a508366f-3512-453c-b508-5f615498c92b tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "POST /compute/v2.1/servers/6803db4b-7556-4e4e-989c-adfa3d140a09/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.151764 Jul 21 10:51:58.391015 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 371/730] 10.222.0.48 () {60 vars in 1322 bytes} [Thu Jul 21 10:51:57 2022] POST /compute/v2.1/servers/6803db4b-7556-4e4e-989c-adfa3d140a09/os-volume_attachments => generated 194 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:51:58.880352 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-85a65e92-65bb-4463-9b5d-24161b809565 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:51:58.880959 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-85a65e92-65bb-4463-9b5d-24161b809565 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: a54643be-3f53-4fe5-bab0-786b71d627bb] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:51:58.887606 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-85a65e92-65bb-4463-9b5d-24161b809565 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:58.888049 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-85a65e92-65bb-4463-9b5d-24161b809565 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:58.888812 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-85a65e92-65bb-4463-9b5d-24161b809565 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:58.889241 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-85a65e92-65bb-4463-9b5d-24161b809565 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:58.987035 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-85a65e92-65bb-4463-9b5d-24161b809565 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:51:58.995508 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-85a65e92-65bb-4463-9b5d-24161b809565 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb" status: 200 len: 1622 microversion: 2.1 time: 0.119043 Jul 21 10:51:58.996643 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 360/731] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:51:58 2022] GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb => generated 1622 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:51:59.061695 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [req-855c2e97-2c0c-4648-a059-0162ddda1ba9 req-f58c7afe-d7be-441e-9ce2-ca64fdf8f19b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a54643be-3f53-4fe5-bab0-786b71d627bb", "name": "network-vif-deleted", "tag": "6ac84834-b64c-48e6-a97a-aed57229fe41"}]} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:51:59.065329 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:51:59.072558 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-855c2e97-2c0c-4648-a059-0162ddda1ba9 req-f58c7afe-d7be-441e-9ce2-ca64fdf8f19b service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:51:59.075704 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-855c2e97-2c0c-4648-a059-0162ddda1ba9 req-f58c7afe-d7be-441e-9ce2-ca64fdf8f19b service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:51:59.086585 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.compute.server_external_events [req-855c2e97-2c0c-4648-a059-0162ddda1ba9 req-f58c7afe-d7be-441e-9ce2-ca64fdf8f19b service nova] Creating event network-vif-deleted:6ac84834-b64c-48e6-a97a-aed57229fe41 for instance a54643be-3f53-4fe5-bab0-786b71d627bb on hv-cinder-84980 Jul 21 10:51:59.094969 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [req-855c2e97-2c0c-4648-a059-0162ddda1ba9 req-f58c7afe-d7be-441e-9ce2-ca64fdf8f19b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097308 Jul 21 10:51:59.095758 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 372/732] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 21 10:51:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 10:52:00.013407 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-4e80d50c-2a85-46d9-845d-e1fb96814048 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:52:00.014157 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-4e80d50c-2a85-46d9-845d-e1fb96814048 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: a54643be-3f53-4fe5-bab0-786b71d627bb] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:52:00.020565 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4e80d50c-2a85-46d9-845d-e1fb96814048 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:00.021054 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4e80d50c-2a85-46d9-845d-e1fb96814048 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:00.021826 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4e80d50c-2a85-46d9-845d-e1fb96814048 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:00.022438 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4e80d50c-2a85-46d9-845d-e1fb96814048 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:00.056219 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4e80d50c-2a85-46d9-845d-e1fb96814048 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:00.056729 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4e80d50c-2a85-46d9-845d-e1fb96814048 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:00.057193 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.objects.instance [None req-4e80d50c-2a85-46d9-845d-e1fb96814048 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lazy-loading 'fault' on Instance uuid a54643be-3f53-4fe5-bab0-786b71d627bb {{(pid=124868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 10:52:00.101200 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-4e80d50c-2a85-46d9-845d-e1fb96814048 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:52:00.109191 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-4e80d50c-2a85-46d9-845d-e1fb96814048 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb" status: 200 len: 1336 microversion: 2.1 time: 0.100094 Jul 21 10:52:00.109787 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 361/733] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:52:00 2022] GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb => generated 1336 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:52:01.126977 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-5caa218a-e1eb-4cde-9d3d-f14ef8570014 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:52:01.127667 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-5caa218a-e1eb-4cde-9d3d-f14ef8570014 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: a54643be-3f53-4fe5-bab0-786b71d627bb] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:52:01.135087 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5caa218a-e1eb-4cde-9d3d-f14ef8570014 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:01.135533 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5caa218a-e1eb-4cde-9d3d-f14ef8570014 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:01.136297 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5caa218a-e1eb-4cde-9d3d-f14ef8570014 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:01.136737 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5caa218a-e1eb-4cde-9d3d-f14ef8570014 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:01.150695 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.wsgi [None req-5caa218a-e1eb-4cde-9d3d-f14ef8570014 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] HTTP exception thrown: Instance a54643be-3f53-4fe5-bab0-786b71d627bb could not be found. Jul 21 10:52:01.152338 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-5caa218a-e1eb-4cde-9d3d-f14ef8570014 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Request method failure captured: Jul 21 10:52:01.152338 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: request: GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb HTTP/1.1 Jul 21 10:52:01.152338 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Accept: application/json Jul 21 10:52:01.152338 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Accept-Encoding: identity Jul 21 10:52:01.152338 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Connection: close Jul 21 10:52:01.152338 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Content-Length: 0 Jul 21 10:52:01.152338 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Content-Type: application/json Jul 21 10:52:01.152338 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Host: 10.222.0.48 Jul 21 10:52:01.152338 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Openstack-System-Scope: None Jul 21 10:52:01.152338 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: User-Agent: python-urllib3/1.26.9 Jul 21 10:52:01.152338 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Auth-Token: gAAAAABi2S6Ceh_4nWphJ8VOdl6H8HFNXSa-qaDU7JzSMyQFmKOVC1-s9RjoIDnnf0b6XhBtJZfkFCZ33MTu8R7SDlIHJinmYsY2WkcMWq4PFgA7k0PzgcXzqdQyXpT96ot3T9mRIIjamqovKw8w4rfRBreiHT2xSl4dltciMM60bd0k4iI4qGs Jul 21 10:52:01.152338 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Domain-Id: None Jul 21 10:52:01.152338 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Domain-Name: None Jul 21 10:52:01.152338 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Identity-Status: Confirmed Jul 21 10:52:01.152338 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Is-Admin-Project: True Jul 21 10:52:01.152338 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Project-Domain-Id: default Jul 21 10:52:01.152338 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Project-Domain-Name: Default Jul 21 10:52:01.152338 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Project-Id: 2ff45af5bd82457b9fd080026ea65b5b Jul 21 10:52:01.152338 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1176570364 Jul 21 10:52:01.152338 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Role: reader,member Jul 21 10:52:01.152338 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Roles: reader,member Jul 21 10:52:01.153949 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2ff45af5bd82457b9fd080026ea65b5b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2ff45af5bd82457b9fd080026ea65b5b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2ff45af5bd82457b9fd080026ea65b5b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2ff45af5bd82457b9fd080026ea65b5b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] Jul 21 10:52:01.153949 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1176570364 Jul 21 10:52:01.153949 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Tenant-Id: 2ff45af5bd82457b9fd080026ea65b5b Jul 21 10:52:01.153949 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1176570364 Jul 21 10:52:01.153949 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User: tempest-ServerRescueNegativeTestJSON-1176570364-project Jul 21 10:52:01.153949 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User-Domain-Id: default Jul 21 10:52:01.153949 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User-Domain-Name: Default Jul 21 10:52:01.153949 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User-Id: a2cb1079722947dfa37946c03b7297a3 Jul 21 10:52:01.153949 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1176570364-project Jul 21 10:52:01.153949 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: method: > Jul 21 10:52:01.153949 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: exception: Instance a54643be-3f53-4fe5-bab0-786b71d627bb could not be found. Jul 21 10:52:01.153949 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: action_args: {'id': 'a54643be-3f53-4fe5-bab0-786b71d627bb'} Jul 21 10:52:01.154919 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 10:52:01.154919 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:52:01.154919 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 10:52:01.154919 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 10:52:01.154919 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 10:52:01.154919 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 10:52:01.154919 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 10:52:01.154919 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 10:52:01.154919 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 10:52:01.154919 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 10:52:01.154919 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a54643be-3f53-4fe5-bab0-786b71d627bb could not be found. Jul 21 10:52:01.154919 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:52:01.154919 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:52:01.154919 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:52:01.154919 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:52:01.154919 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:52:01.154919 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:52:01.154919 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 10:52:01.154919 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 10:52:01.154919 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 10:52:01.156548 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 10:52:01.156548 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 10:52:01.156548 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 10:52:01.156548 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 10:52:01.156548 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 10:52:01.156548 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 10:52:01.156548 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 10:52:01.156548 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a54643be-3f53-4fe5-bab0-786b71d627bb could not be found. Jul 21 10:52:01.156548 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:52:01.156548 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:52:01.156548 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:52:01.156548 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:52:01.156548 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:52:01.156548 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:52:01.156548 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 10:52:01.156548 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 10:52:01.156548 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a54643be-3f53-4fe5-bab0-786b71d627bb could not be found. Jul 21 10:52:01.156548 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:52:01.158279 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-5caa218a-e1eb-4cde-9d3d-f14ef8570014 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Returning 404 to user: Instance a54643be-3f53-4fe5-bab0-786b71d627bb could not be found. {{(pid=124867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 10:52:01.158279 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-5caa218a-e1eb-4cde-9d3d-f14ef8570014 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb" status: 404 len: 111 microversion: 2.1 time: 0.031073 Jul 21 10:52:01.158279 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 373/734] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:52:01 2022] GET /compute/v2.1/servers/a54643be-3f53-4fe5-bab0-786b71d627bb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 10:52:01.163231 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-a2360516-6896-46a1-b110-7b064bf0dd55 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '.version_select at 0x7f79629d3dc0>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:52:01.237449 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-a2360516-6896-46a1-b110-7b064bf0dd55 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1487295281" status: 202 len: 0 microversion: 2.1 time: 0.078635 Jul 21 10:52:01.238026 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 362/735] 10.222.0.48 () {58 vars in 1220 bytes} [Thu Jul 21 10:52:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1487295281 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 10:52:04.433069 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-a220791b-96d9-4e41-bb36-7f80e702d829 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:52:04.433598 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-a220791b-96d9-4e41-bb36-7f80e702d829 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: 86715109-fd38-41f4-b384-a319c310fc44] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:52:04.440502 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a220791b-96d9-4e41-bb36-7f80e702d829 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:04.440952 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a220791b-96d9-4e41-bb36-7f80e702d829 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:04.441707 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a220791b-96d9-4e41-bb36-7f80e702d829 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:04.442139 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a220791b-96d9-4e41-bb36-7f80e702d829 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:04.468548 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-a220791b-96d9-4e41-bb36-7f80e702d829 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: 86715109-fd38-41f4-b384-a319c310fc44] Going to try to terminate instance {{(pid=124867) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 10:52:04.772953 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-a220791b-96d9-4e41-bb36-7f80e702d829 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "DELETE /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44" status: 204 len: 0 microversion: 2.1 time: 0.343302 Jul 21 10:52:04.773543 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 374/736] 10.222.0.48 () {58 vars in 1238 bytes} [Thu Jul 21 10:52:04 2022] DELETE /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 10:52:04.782064 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-889e638c-e9d6-4be6-9cd3-a4c1e06dbf9d tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:52:04.787015 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-889e638c-e9d6-4be6-9cd3-a4c1e06dbf9d tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: 86715109-fd38-41f4-b384-a319c310fc44] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:52:04.789289 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-889e638c-e9d6-4be6-9cd3-a4c1e06dbf9d tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:04.789726 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-889e638c-e9d6-4be6-9cd3-a4c1e06dbf9d tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:04.790476 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-889e638c-e9d6-4be6-9cd3-a4c1e06dbf9d tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:04.790928 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-889e638c-e9d6-4be6-9cd3-a4c1e06dbf9d tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:04.922990 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-889e638c-e9d6-4be6-9cd3-a4c1e06dbf9d tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:52:04.930414 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-889e638c-e9d6-4be6-9cd3-a4c1e06dbf9d tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44" status: 200 len: 1508 microversion: 2.1 time: 0.152150 Jul 21 10:52:04.931011 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 363/737] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:52:04 2022] GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44 => generated 1508 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:52:05.949076 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-045d7ce4-8021-4e9d-a511-2454b05f9686 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:52:05.949944 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-045d7ce4-8021-4e9d-a511-2454b05f9686 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: 86715109-fd38-41f4-b384-a319c310fc44] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:52:05.956448 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-045d7ce4-8021-4e9d-a511-2454b05f9686 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:05.956894 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-045d7ce4-8021-4e9d-a511-2454b05f9686 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:05.957650 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-045d7ce4-8021-4e9d-a511-2454b05f9686 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:05.958086 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-045d7ce4-8021-4e9d-a511-2454b05f9686 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:06.088235 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-045d7ce4-8021-4e9d-a511-2454b05f9686 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:52:06.095921 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-045d7ce4-8021-4e9d-a511-2454b05f9686 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44" status: 200 len: 1508 microversion: 2.1 time: 0.151720 Jul 21 10:52:06.096493 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 375/738] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:52:05 2022] GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44 => generated 1508 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:52:07.113662 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-a43e8667-9ca8-43e4-b9ea-2062d75fe69f tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:52:07.114206 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-a43e8667-9ca8-43e4-b9ea-2062d75fe69f tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: 86715109-fd38-41f4-b384-a319c310fc44] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:52:07.120978 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a43e8667-9ca8-43e4-b9ea-2062d75fe69f tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:07.121417 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a43e8667-9ca8-43e4-b9ea-2062d75fe69f tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:07.122167 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a43e8667-9ca8-43e4-b9ea-2062d75fe69f tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:07.122616 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a43e8667-9ca8-43e4-b9ea-2062d75fe69f tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:07.251755 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-a43e8667-9ca8-43e4-b9ea-2062d75fe69f tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:52:07.259003 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-a43e8667-9ca8-43e4-b9ea-2062d75fe69f tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44" status: 200 len: 1508 microversion: 2.1 time: 0.149230 Jul 21 10:52:07.259564 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 364/739] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:52:07 2022] GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44 => generated 1508 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:52:08.276078 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-717ada1e-0afa-4f5f-b18b-27f40b3f6d21 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:52:08.277262 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-717ada1e-0afa-4f5f-b18b-27f40b3f6d21 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: 86715109-fd38-41f4-b384-a319c310fc44] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:52:08.283762 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-717ada1e-0afa-4f5f-b18b-27f40b3f6d21 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:08.284205 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-717ada1e-0afa-4f5f-b18b-27f40b3f6d21 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:08.284965 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-717ada1e-0afa-4f5f-b18b-27f40b3f6d21 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:08.285400 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-717ada1e-0afa-4f5f-b18b-27f40b3f6d21 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:08.449532 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-717ada1e-0afa-4f5f-b18b-27f40b3f6d21 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:52:08.457525 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-717ada1e-0afa-4f5f-b18b-27f40b3f6d21 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44" status: 200 len: 1508 microversion: 2.1 time: 0.185424 Jul 21 10:52:08.458082 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 376/740] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:52:08 2022] GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44 => generated 1508 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:52:08.565715 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [req-786bab67-1337-42e2-806e-1432412f8983 req-f4149029-c0d9-49c2-911f-6c4e6872ee5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86715109-fd38-41f4-b384-a319c310fc44", "name": "network-vif-deleted", "tag": "2f00b65f-1c5b-4127-be24-1cea853f5f63"}]} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:52:08.576822 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-786bab67-1337-42e2-806e-1432412f8983 req-f4149029-c0d9-49c2-911f-6c4e6872ee5d service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:08.577441 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-786bab67-1337-42e2-806e-1432412f8983 req-f4149029-c0d9-49c2-911f-6c4e6872ee5d service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:08.589523 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.compute.server_external_events [req-786bab67-1337-42e2-806e-1432412f8983 req-f4149029-c0d9-49c2-911f-6c4e6872ee5d service nova] Creating event network-vif-deleted:2f00b65f-1c5b-4127-be24-1cea853f5f63 for instance 86715109-fd38-41f4-b384-a319c310fc44 on hv-cinder-84980 Jul 21 10:52:08.595022 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [req-786bab67-1337-42e2-806e-1432412f8983 req-f4149029-c0d9-49c2-911f-6c4e6872ee5d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032939 Jul 21 10:52:08.595879 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 365/741] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 21 10:52:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:52:09.040791 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-292ec5e4-384e-49bb-9545-eb575e1e1af2 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "be4a3207-0c47-4fee-b1da-ac656ea7c482"}} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:52:09.042528 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-292ec5e4-384e-49bb-9545-eb575e1e1af2 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 6803db4b-7556-4e4e-989c-adfa3d140a09] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:52:09.048454 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-292ec5e4-384e-49bb-9545-eb575e1e1af2 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:09.050242 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-292ec5e4-384e-49bb-9545-eb575e1e1af2 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:09.050242 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-292ec5e4-384e-49bb-9545-eb575e1e1af2 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:09.050242 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-292ec5e4-384e-49bb-9545-eb575e1e1af2 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:09.053645 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:52:09.128576 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.wsgi [None req-292ec5e4-384e-49bb-9545-eb575e1e1af2 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] HTTP exception thrown: Invalid volume: volume be4a3207-0c47-4fee-b1da-ac656ea7c482 is already attached to instances: 6803db4b-7556-4e4e-989c-adfa3d140a09 Jul 21 10:52:09.130280 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-292ec5e4-384e-49bb-9545-eb575e1e1af2 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Request method failure captured: Jul 21 10:52:09.130280 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: request: POST /compute/v2.1/servers/6803db4b-7556-4e4e-989c-adfa3d140a09/os-volume_attachments HTTP/1.1 Jul 21 10:52:09.130280 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Accept: application/json Jul 21 10:52:09.130280 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Accept-Encoding: identity Jul 21 10:52:09.130280 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Connection: close Jul 21 10:52:09.130280 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Content-Length: 74 Jul 21 10:52:09.130280 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Content-Type: application/json Jul 21 10:52:09.130280 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Host: 10.222.0.48 Jul 21 10:52:09.130280 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Openstack-System-Scope: None Jul 21 10:52:09.130280 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: User-Agent: python-urllib3/1.26.9 Jul 21 10:52:09.130280 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Auth-Token: gAAAAABi2S6IjD13fpvyB3gT_wfBhrxBWJW9IyP2Nfh-tKREma2qJlItcJifOI1FikOPoU86kC4jMPIUJv7c1XQEgHyn13RPV4dm8YXLpWP83NoB7MDue-0ef8jz1-9ETLoC72jgbX7x_bNoV_fia9kSfgVPDrqxya-pNvknwmV6TjdQwJPLki8 Jul 21 10:52:09.130280 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Domain-Id: None Jul 21 10:52:09.130280 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Domain-Name: None Jul 21 10:52:09.130280 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Identity-Status: Confirmed Jul 21 10:52:09.130280 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Is-Admin-Project: True Jul 21 10:52:09.130280 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Project-Domain-Id: default Jul 21 10:52:09.130280 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Project-Domain-Name: Default Jul 21 10:52:09.130280 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Project-Id: 0dc215aadb5345d791945658832aae4a Jul 21 10:52:09.130280 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Project-Name: tempest-AttachVolumeNegativeTest-692763952 Jul 21 10:52:09.130280 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Role: reader,member Jul 21 10:52:09.130280 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Roles: reader,member Jul 21 10:52:09.131795 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0dc215aadb5345d791945658832aae4a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0dc215aadb5345d791945658832aae4a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0dc215aadb5345d791945658832aae4a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0dc215aadb5345d791945658832aae4a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] Jul 21 10:52:09.131795 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Tenant: tempest-AttachVolumeNegativeTest-692763952 Jul 21 10:52:09.131795 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Tenant-Id: 0dc215aadb5345d791945658832aae4a Jul 21 10:52:09.131795 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-692763952 Jul 21 10:52:09.131795 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User: tempest-AttachVolumeNegativeTest-692763952-project Jul 21 10:52:09.131795 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User-Domain-Id: default Jul 21 10:52:09.131795 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User-Domain-Name: Default Jul 21 10:52:09.131795 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User-Id: 906e4bc4e9cc45ecb01cfca7918e461d Jul 21 10:52:09.131795 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User-Name: tempest-AttachVolumeNegativeTest-692763952-project Jul 21 10:52:09.131795 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Jul 21 10:52:09.131795 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: {"volumeAttachment": {"volumeId": "be4a3207-0c47-4fee-b1da-ac656ea7c482"}} Jul 21 10:52:09.131795 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: method: > Jul 21 10:52:09.132654 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: exception: Invalid volume: volume be4a3207-0c47-4fee-b1da-ac656ea7c482 is already attached to instances: 6803db4b-7556-4e4e-989c-adfa3d140a09 Jul 21 10:52:09.132654 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: action_args: {'server_id': '6803db4b-7556-4e4e-989c-adfa3d140a09', 'body': {'volumeAttachment': {'volumeId': 'be4a3207-0c47-4fee-b1da-ac656ea7c482'}}} Jul 21 10:52:09.132654 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 10:52:09.132654 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:52:09.132654 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 21 10:52:09.132654 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 21 10:52:09.132654 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 21 10:52:09.132654 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 21 10:52:09.132654 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 21 10:52:09.132654 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 21 10:52:09.132654 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 21 10:52:09.132654 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 21 10:52:09.132654 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 21 10:52:09.132654 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 21 10:52:09.132654 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume be4a3207-0c47-4fee-b1da-ac656ea7c482 is already attached to instances: 6803db4b-7556-4e4e-989c-adfa3d140a09 Jul 21 10:52:09.132654 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:52:09.132654 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:52:09.132654 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:52:09.132654 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:52:09.134027 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:52:09.134027 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:52:09.134027 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 10:52:09.134027 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 10:52:09.134027 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 10:52:09.134027 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 10:52:09.134027 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 21 10:52:09.134027 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 10:52:09.134027 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 21 10:52:09.134027 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 10:52:09.134027 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 21 10:52:09.134027 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 10:52:09.134027 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 21 10:52:09.134027 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 21 10:52:09.134027 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume be4a3207-0c47-4fee-b1da-ac656ea7c482 is already attached to instances: 6803db4b-7556-4e4e-989c-adfa3d140a09 Jul 21 10:52:09.134027 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:52:09.134027 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:52:09.134027 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:52:09.134027 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:52:09.134027 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:52:09.136998 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:52:09.136998 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 10:52:09.136998 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 10:52:09.136998 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume be4a3207-0c47-4fee-b1da-ac656ea7c482 is already attached to instances: 6803db4b-7556-4e4e-989c-adfa3d140a09 Jul 21 10:52:09.136998 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:52:09.136998 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-292ec5e4-384e-49bb-9545-eb575e1e1af2 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Returning 400 to user: Invalid volume: volume be4a3207-0c47-4fee-b1da-ac656ea7c482 is already attached to instances: 6803db4b-7556-4e4e-989c-adfa3d140a09 {{(pid=124867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 10:52:09.136998 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-292ec5e4-384e-49bb-9545-eb575e1e1af2 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "POST /compute/v2.1/servers/6803db4b-7556-4e4e-989c-adfa3d140a09/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.094867 Jul 21 10:52:09.136998 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 377/742] 10.222.0.48 () {60 vars in 1322 bytes} [Thu Jul 21 10:52:09 2022] POST /compute/v2.1/servers/6803db4b-7556-4e4e-989c-adfa3d140a09/os-volume_attachments => generated 174 bytes in 96 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 21 10:52:09.192743 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-df9d96f0-c15a-4df9-8d5b-96a55d0b6ad4 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:52:09.193326 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-df9d96f0-c15a-4df9-8d5b-96a55d0b6ad4 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 6803db4b-7556-4e4e-989c-adfa3d140a09] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:52:09.200239 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-df9d96f0-c15a-4df9-8d5b-96a55d0b6ad4 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:09.200683 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-df9d96f0-c15a-4df9-8d5b-96a55d0b6ad4 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:09.201443 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-df9d96f0-c15a-4df9-8d5b-96a55d0b6ad4 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:09.201873 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-df9d96f0-c15a-4df9-8d5b-96a55d0b6ad4 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:09.281809 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.objects.instance [None req-df9d96f0-c15a-4df9-8d5b-96a55d0b6ad4 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lazy-loading 'services' on Instance uuid 6803db4b-7556-4e4e-989c-adfa3d140a09 {{(pid=124868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 10:52:09.475792 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-7b958b4e-10da-4113-9387-2ff361edcf2b tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:52:09.476402 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-7b958b4e-10da-4113-9387-2ff361edcf2b tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: 86715109-fd38-41f4-b384-a319c310fc44] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:52:09.483334 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7b958b4e-10da-4113-9387-2ff361edcf2b tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:09.483783 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7b958b4e-10da-4113-9387-2ff361edcf2b tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:09.484544 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7b958b4e-10da-4113-9387-2ff361edcf2b tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:09.484980 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7b958b4e-10da-4113-9387-2ff361edcf2b tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:09.515900 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7b958b4e-10da-4113-9387-2ff361edcf2b tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:09.516346 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7b958b4e-10da-4113-9387-2ff361edcf2b tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:09.516852 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.objects.instance [None req-7b958b4e-10da-4113-9387-2ff361edcf2b tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lazy-loading 'fault' on Instance uuid 86715109-fd38-41f4-b384-a319c310fc44 {{(pid=124867) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 10:52:09.517108 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-df9d96f0-c15a-4df9-8d5b-96a55d0b6ad4 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "DELETE /compute/v2.1/servers/6803db4b-7556-4e4e-989c-adfa3d140a09/os-volume_attachments/be4a3207-0c47-4fee-b1da-ac656ea7c482" status: 202 len: 0 microversion: 2.1 time: 0.328060 Jul 21 10:52:09.517749 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 366/743] 10.222.0.48 () {58 vars in 1415 bytes} [Thu Jul 21 10:52:09 2022] DELETE /compute/v2.1/servers/6803db4b-7556-4e4e-989c-adfa3d140a09/os-volume_attachments/be4a3207-0c47-4fee-b1da-ac656ea7c482 => generated 0 bytes in 330 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 10:52:09.528585 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-bb0b2e3f-87e8-401f-8f00-e634b4b3e9b7 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:52:09.529650 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-bb0b2e3f-87e8-401f-8f00-e634b4b3e9b7 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 6803db4b-7556-4e4e-989c-adfa3d140a09] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:52:09.538726 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-bb0b2e3f-87e8-401f-8f00-e634b4b3e9b7 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:09.539350 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-bb0b2e3f-87e8-401f-8f00-e634b4b3e9b7 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:09.540277 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-bb0b2e3f-87e8-401f-8f00-e634b4b3e9b7 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:09.540707 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-bb0b2e3f-87e8-401f-8f00-e634b4b3e9b7 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:09.566416 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-7b958b4e-10da-4113-9387-2ff361edcf2b tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:52:09.574430 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-7b958b4e-10da-4113-9387-2ff361edcf2b tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44" status: 200 len: 1311 microversion: 2.1 time: 0.102748 Jul 21 10:52:09.575345 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 378/744] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:52:09 2022] GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44 => generated 1311 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:52:09.581000 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-bb0b2e3f-87e8-401f-8f00-e634b4b3e9b7 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/6803db4b-7556-4e4e-989c-adfa3d140a09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052921 Jul 21 10:52:09.583892 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 367/745] 10.222.0.48 () {58 vars in 1301 bytes} [Thu Jul 21 10:52:09 2022] GET /compute/v2.1/servers/6803db4b-7556-4e4e-989c-adfa3d140a09/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 10:52:10.591834 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-0cd2ee39-466c-4e30-b773-1c7ce544f1fe tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:52:10.592446 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-0cd2ee39-466c-4e30-b773-1c7ce544f1fe tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: 86715109-fd38-41f4-b384-a319c310fc44] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:52:10.594623 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-dbfce881-f7a2-4b94-9cf5-06c55f379f4b tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:52:10.595547 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-dbfce881-f7a2-4b94-9cf5-06c55f379f4b tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 6803db4b-7556-4e4e-989c-adfa3d140a09] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:52:10.599376 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0cd2ee39-466c-4e30-b773-1c7ce544f1fe tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:10.599714 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0cd2ee39-466c-4e30-b773-1c7ce544f1fe tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:10.600491 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0cd2ee39-466c-4e30-b773-1c7ce544f1fe tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:10.600935 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0cd2ee39-466c-4e30-b773-1c7ce544f1fe tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:10.602081 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-dbfce881-f7a2-4b94-9cf5-06c55f379f4b tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:10.602744 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-dbfce881-f7a2-4b94-9cf5-06c55f379f4b tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:10.603721 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-dbfce881-f7a2-4b94-9cf5-06c55f379f4b tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:10.604182 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-dbfce881-f7a2-4b94-9cf5-06c55f379f4b tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:10.615536 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.wsgi [None req-0cd2ee39-466c-4e30-b773-1c7ce544f1fe tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] HTTP exception thrown: Instance 86715109-fd38-41f4-b384-a319c310fc44 could not be found. Jul 21 10:52:10.617145 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-0cd2ee39-466c-4e30-b773-1c7ce544f1fe tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Request method failure captured: Jul 21 10:52:10.617145 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: request: GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44 HTTP/1.1 Jul 21 10:52:10.617145 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Accept: application/json Jul 21 10:52:10.617145 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Accept-Encoding: identity Jul 21 10:52:10.617145 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Connection: close Jul 21 10:52:10.617145 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Content-Length: 0 Jul 21 10:52:10.617145 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Content-Type: application/json Jul 21 10:52:10.617145 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Host: 10.222.0.48 Jul 21 10:52:10.617145 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Openstack-System-Scope: None Jul 21 10:52:10.617145 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: User-Agent: python-urllib3/1.26.9 Jul 21 10:52:10.617145 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Auth-Token: gAAAAABi2S6Ceh_4nWphJ8VOdl6H8HFNXSa-qaDU7JzSMyQFmKOVC1-s9RjoIDnnf0b6XhBtJZfkFCZ33MTu8R7SDlIHJinmYsY2WkcMWq4PFgA7k0PzgcXzqdQyXpT96ot3T9mRIIjamqovKw8w4rfRBreiHT2xSl4dltciMM60bd0k4iI4qGs Jul 21 10:52:10.617145 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Domain-Id: None Jul 21 10:52:10.617145 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Domain-Name: None Jul 21 10:52:10.617145 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Identity-Status: Confirmed Jul 21 10:52:10.617145 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Is-Admin-Project: True Jul 21 10:52:10.617145 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Project-Domain-Id: default Jul 21 10:52:10.617145 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Project-Domain-Name: Default Jul 21 10:52:10.617145 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Project-Id: 2ff45af5bd82457b9fd080026ea65b5b Jul 21 10:52:10.617145 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1176570364 Jul 21 10:52:10.617145 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Role: reader,member Jul 21 10:52:10.617145 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Roles: reader,member Jul 21 10:52:10.618725 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2ff45af5bd82457b9fd080026ea65b5b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2ff45af5bd82457b9fd080026ea65b5b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2ff45af5bd82457b9fd080026ea65b5b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2ff45af5bd82457b9fd080026ea65b5b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] Jul 21 10:52:10.618725 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1176570364 Jul 21 10:52:10.618725 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Tenant-Id: 2ff45af5bd82457b9fd080026ea65b5b Jul 21 10:52:10.618725 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1176570364 Jul 21 10:52:10.618725 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User: tempest-ServerRescueNegativeTestJSON-1176570364-project Jul 21 10:52:10.618725 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User-Domain-Id: default Jul 21 10:52:10.618725 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User-Domain-Name: Default Jul 21 10:52:10.618725 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User-Id: a2cb1079722947dfa37946c03b7297a3 Jul 21 10:52:10.618725 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1176570364-project Jul 21 10:52:10.618725 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: method: > Jul 21 10:52:10.618725 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: exception: Instance 86715109-fd38-41f4-b384-a319c310fc44 could not be found. Jul 21 10:52:10.618725 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: action_args: {'id': '86715109-fd38-41f4-b384-a319c310fc44'} Jul 21 10:52:10.619625 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 10:52:10.619625 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:52:10.619625 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 10:52:10.619625 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 10:52:10.619625 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 10:52:10.619625 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 10:52:10.619625 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 10:52:10.619625 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 10:52:10.619625 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 10:52:10.619625 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 10:52:10.619625 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86715109-fd38-41f4-b384-a319c310fc44 could not be found. Jul 21 10:52:10.619625 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:52:10.619625 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:52:10.619625 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:52:10.619625 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:52:10.619625 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:52:10.619625 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:52:10.619625 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 10:52:10.619625 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 10:52:10.619625 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 10:52:10.622347 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 10:52:10.622347 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 10:52:10.622347 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 10:52:10.622347 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 10:52:10.622347 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 10:52:10.622347 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 10:52:10.622347 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 10:52:10.622347 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86715109-fd38-41f4-b384-a319c310fc44 could not be found. Jul 21 10:52:10.622347 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:52:10.622347 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:52:10.622347 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:52:10.622347 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:52:10.622347 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:52:10.622347 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:52:10.622347 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 10:52:10.622347 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 10:52:10.622347 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86715109-fd38-41f4-b384-a319c310fc44 could not be found. Jul 21 10:52:10.622347 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:52:10.623795 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-0cd2ee39-466c-4e30-b773-1c7ce544f1fe tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Returning 404 to user: Instance 86715109-fd38-41f4-b384-a319c310fc44 could not be found. {{(pid=124867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 10:52:10.623795 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-0cd2ee39-466c-4e30-b773-1c7ce544f1fe tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44" status: 404 len: 111 microversion: 2.1 time: 0.031099 Jul 21 10:52:10.623795 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 379/746] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:52:10 2022] GET /compute/v2.1/servers/86715109-fd38-41f4-b384-a319c310fc44 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 10:52:10.628054 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-477c13f8-7e65-4f60-b0bc-01edb6632764 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:52:10.628555 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-477c13f8-7e65-4f60-b0bc-01edb6632764 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: b7a76827-1907-4bf4-b27c-945b33b2316d] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:52:10.634909 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-477c13f8-7e65-4f60-b0bc-01edb6632764 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:10.635364 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-477c13f8-7e65-4f60-b0bc-01edb6632764 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:10.636140 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-477c13f8-7e65-4f60-b0bc-01edb6632764 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:10.636575 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-477c13f8-7e65-4f60-b0bc-01edb6632764 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:10.637244 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-dbfce881-f7a2-4b94-9cf5-06c55f379f4b tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/6803db4b-7556-4e4e-989c-adfa3d140a09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046376 Jul 21 10:52:10.638050 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 368/747] 10.222.0.48 () {58 vars in 1301 bytes} [Thu Jul 21 10:52:10 2022] GET /compute/v2.1/servers/6803db4b-7556-4e4e-989c-adfa3d140a09/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 10:52:10.661488 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-477c13f8-7e65-4f60-b0bc-01edb6632764 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: b7a76827-1907-4bf4-b27c-945b33b2316d] Going to try to terminate instance {{(pid=124867) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 10:52:10.944675 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-477c13f8-7e65-4f60-b0bc-01edb6632764 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "DELETE /compute/v2.1/servers/b7a76827-1907-4bf4-b27c-945b33b2316d" status: 204 len: 0 microversion: 2.1 time: 0.319972 Jul 21 10:52:10.945264 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 380/748] 10.222.0.48 () {58 vars in 1238 bytes} [Thu Jul 21 10:52:10 2022] DELETE /compute/v2.1/servers/b7a76827-1907-4bf4-b27c-945b33b2316d => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 10:52:10.953777 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-fa72fceb-b63e-4ca7-bd57-ecfbe0c8687e tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:52:10.954400 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-fa72fceb-b63e-4ca7-bd57-ecfbe0c8687e tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: b7a76827-1907-4bf4-b27c-945b33b2316d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:52:10.960566 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-fa72fceb-b63e-4ca7-bd57-ecfbe0c8687e tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:10.961005 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-fa72fceb-b63e-4ca7-bd57-ecfbe0c8687e tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:10.961750 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-fa72fceb-b63e-4ca7-bd57-ecfbe0c8687e tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:10.962178 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-fa72fceb-b63e-4ca7-bd57-ecfbe0c8687e tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:11.093946 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-fa72fceb-b63e-4ca7-bd57-ecfbe0c8687e tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:52:11.101525 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-fa72fceb-b63e-4ca7-bd57-ecfbe0c8687e tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/b7a76827-1907-4bf4-b27c-945b33b2316d" status: 200 len: 1522 microversion: 2.1 time: 0.151498 Jul 21 10:52:11.102136 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 369/749] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:52:10 2022] GET /compute/v2.1/servers/b7a76827-1907-4bf4-b27c-945b33b2316d => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:52:11.649517 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-738f8ab9-6c94-4fff-9f8c-7d5d29995afc tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:52:11.650449 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-738f8ab9-6c94-4fff-9f8c-7d5d29995afc tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 6803db4b-7556-4e4e-989c-adfa3d140a09] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:52:11.657524 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-738f8ab9-6c94-4fff-9f8c-7d5d29995afc tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:11.657971 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-738f8ab9-6c94-4fff-9f8c-7d5d29995afc tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:11.658758 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-738f8ab9-6c94-4fff-9f8c-7d5d29995afc tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:11.659194 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-738f8ab9-6c94-4fff-9f8c-7d5d29995afc tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:11.687894 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-738f8ab9-6c94-4fff-9f8c-7d5d29995afc tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/6803db4b-7556-4e4e-989c-adfa3d140a09/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042814 Jul 21 10:52:11.688519 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 381/750] 10.222.0.48 () {58 vars in 1301 bytes} [Thu Jul 21 10:52:11 2022] GET /compute/v2.1/servers/6803db4b-7556-4e4e-989c-adfa3d140a09/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 21 10:52:11.745634 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-5f684aea-7ae2-4d7d-8a20-7178e1a18f13 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:52:11.746301 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-5f684aea-7ae2-4d7d-8a20-7178e1a18f13 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 6803db4b-7556-4e4e-989c-adfa3d140a09] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:52:11.752629 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5f684aea-7ae2-4d7d-8a20-7178e1a18f13 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:11.753072 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5f684aea-7ae2-4d7d-8a20-7178e1a18f13 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:11.753819 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5f684aea-7ae2-4d7d-8a20-7178e1a18f13 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:11.754245 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5f684aea-7ae2-4d7d-8a20-7178e1a18f13 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:11.758158 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=98 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:52:11.780434 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-5f684aea-7ae2-4d7d-8a20-7178e1a18f13 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 6803db4b-7556-4e4e-989c-adfa3d140a09] Going to try to terminate instance {{(pid=124868) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 10:52:12.105564 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-5f684aea-7ae2-4d7d-8a20-7178e1a18f13 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "DELETE /compute/v2.1/servers/6803db4b-7556-4e4e-989c-adfa3d140a09" status: 204 len: 0 microversion: 2.1 time: 0.362947 Jul 21 10:52:12.106179 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 370/751] 10.222.0.48 () {58 vars in 1238 bytes} [Thu Jul 21 10:52:11 2022] DELETE /compute/v2.1/servers/6803db4b-7556-4e4e-989c-adfa3d140a09 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 10:52:12.114289 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-4176b515-35fd-48cd-a47a-d8665aca23b1 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:52:12.114930 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-4176b515-35fd-48cd-a47a-d8665aca23b1 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 6803db4b-7556-4e4e-989c-adfa3d140a09] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:52:12.120221 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-ffa59012-f225-44fc-9d36-b03122599464 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:52:12.121679 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-ffa59012-f225-44fc-9d36-b03122599464 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: b7a76827-1907-4bf4-b27c-945b33b2316d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:52:12.121844 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-4176b515-35fd-48cd-a47a-d8665aca23b1 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:12.122246 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-4176b515-35fd-48cd-a47a-d8665aca23b1 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:12.123092 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-4176b515-35fd-48cd-a47a-d8665aca23b1 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:12.123531 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-4176b515-35fd-48cd-a47a-d8665aca23b1 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:12.127765 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ffa59012-f225-44fc-9d36-b03122599464 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:12.128210 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ffa59012-f225-44fc-9d36-b03122599464 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:12.129001 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ffa59012-f225-44fc-9d36-b03122599464 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:12.129431 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ffa59012-f225-44fc-9d36-b03122599464 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:12.321635 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-4176b515-35fd-48cd-a47a-d8665aca23b1 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906e4bc4e9cc45ecb01cfca7918e461d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc215aadb5345d791945658832aae4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:52:12.325336 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-ffa59012-f225-44fc-9d36-b03122599464 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:52:12.329111 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-4176b515-35fd-48cd-a47a-d8665aca23b1 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/6803db4b-7556-4e4e-989c-adfa3d140a09" status: 200 len: 1680 microversion: 2.1 time: 0.218660 Jul 21 10:52:12.329731 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 382/752] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:52:12 2022] GET /compute/v2.1/servers/6803db4b-7556-4e4e-989c-adfa3d140a09 => generated 1680 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:52:12.333301 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-ffa59012-f225-44fc-9d36-b03122599464 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/b7a76827-1907-4bf4-b27c-945b33b2316d" status: 200 len: 1522 microversion: 2.1 time: 0.217148 Jul 21 10:52:12.333845 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 371/753] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:52:12 2022] GET /compute/v2.1/servers/b7a76827-1907-4bf4-b27c-945b33b2316d => generated 1522 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:52:13.346404 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-ad7c6070-f5d9-460d-be16-17c1e92b8b0f tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:52:13.347050 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-ad7c6070-f5d9-460d-be16-17c1e92b8b0f tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 6803db4b-7556-4e4e-989c-adfa3d140a09] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:52:13.351033 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-733b49e2-84f4-4e72-996a-e94093c8e323 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:52:13.351640 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-733b49e2-84f4-4e72-996a-e94093c8e323 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: b7a76827-1907-4bf4-b27c-945b33b2316d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:52:13.353580 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ad7c6070-f5d9-460d-be16-17c1e92b8b0f tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:13.354031 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ad7c6070-f5d9-460d-be16-17c1e92b8b0f tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:13.354822 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ad7c6070-f5d9-460d-be16-17c1e92b8b0f tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:13.355345 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ad7c6070-f5d9-460d-be16-17c1e92b8b0f tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:13.358017 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-733b49e2-84f4-4e72-996a-e94093c8e323 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:13.358462 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-733b49e2-84f4-4e72-996a-e94093c8e323 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:13.359254 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-733b49e2-84f4-4e72-996a-e94093c8e323 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:13.360444 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-733b49e2-84f4-4e72-996a-e94093c8e323 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:13.563148 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-733b49e2-84f4-4e72-996a-e94093c8e323 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:52:13.566567 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-ad7c6070-f5d9-460d-be16-17c1e92b8b0f tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906e4bc4e9cc45ecb01cfca7918e461d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc215aadb5345d791945658832aae4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:52:13.571387 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-733b49e2-84f4-4e72-996a-e94093c8e323 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/b7a76827-1907-4bf4-b27c-945b33b2316d" status: 200 len: 1522 microversion: 2.1 time: 0.224268 Jul 21 10:52:13.572879 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 372/754] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:52:13 2022] GET /compute/v2.1/servers/b7a76827-1907-4bf4-b27c-945b33b2316d => generated 1522 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:52:13.576980 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-ad7c6070-f5d9-460d-be16-17c1e92b8b0f tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/6803db4b-7556-4e4e-989c-adfa3d140a09" status: 200 len: 1680 microversion: 2.1 time: 0.234615 Jul 21 10:52:13.578649 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 383/755] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:52:13 2022] GET /compute/v2.1/servers/6803db4b-7556-4e4e-989c-adfa3d140a09 => generated 1680 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:52:14.589293 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-6708453e-9909-419b-92b7-54c273d3e822 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:52:14.590333 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-6708453e-9909-419b-92b7-54c273d3e822 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: b7a76827-1907-4bf4-b27c-945b33b2316d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:52:14.594358 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-38d11c06-89e5-426c-a487-677139dcc4b5 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:52:14.594989 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-38d11c06-89e5-426c-a487-677139dcc4b5 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 6803db4b-7556-4e4e-989c-adfa3d140a09] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:52:14.596812 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6708453e-9909-419b-92b7-54c273d3e822 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:14.597257 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6708453e-9909-419b-92b7-54c273d3e822 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:14.598013 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6708453e-9909-419b-92b7-54c273d3e822 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:14.598436 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6708453e-9909-419b-92b7-54c273d3e822 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:14.601320 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-38d11c06-89e5-426c-a487-677139dcc4b5 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:14.601759 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-38d11c06-89e5-426c-a487-677139dcc4b5 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:14.602512 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-38d11c06-89e5-426c-a487-677139dcc4b5 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:14.602963 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-38d11c06-89e5-426c-a487-677139dcc4b5 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:14.794382 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-6708453e-9909-419b-92b7-54c273d3e822 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:52:14.799032 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-38d11c06-89e5-426c-a487-677139dcc4b5 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906e4bc4e9cc45ecb01cfca7918e461d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc215aadb5345d791945658832aae4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:52:14.802445 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-6708453e-9909-419b-92b7-54c273d3e822 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/b7a76827-1907-4bf4-b27c-945b33b2316d" status: 200 len: 1522 microversion: 2.1 time: 0.216974 Jul 21 10:52:14.803125 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 373/756] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:52:14 2022] GET /compute/v2.1/servers/b7a76827-1907-4bf4-b27c-945b33b2316d => generated 1522 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:52:14.807095 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-38d11c06-89e5-426c-a487-677139dcc4b5 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/6803db4b-7556-4e4e-989c-adfa3d140a09" status: 200 len: 1680 microversion: 2.1 time: 0.216444 Jul 21 10:52:14.807706 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 384/757] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:52:14 2022] GET /compute/v2.1/servers/6803db4b-7556-4e4e-989c-adfa3d140a09 => generated 1680 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:52:15.820542 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-c1b101e0-75bf-4689-827e-05cd998d1658 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:52:15.822130 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-c1b101e0-75bf-4689-827e-05cd998d1658 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: b7a76827-1907-4bf4-b27c-945b33b2316d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:52:15.824366 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-1f1363f5-f0c3-4768-b135-023f7df19c1b tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:52:15.825219 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-1f1363f5-f0c3-4768-b135-023f7df19c1b tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 6803db4b-7556-4e4e-989c-adfa3d140a09] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:52:15.830117 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c1b101e0-75bf-4689-827e-05cd998d1658 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:15.830371 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c1b101e0-75bf-4689-827e-05cd998d1658 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:15.831191 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c1b101e0-75bf-4689-827e-05cd998d1658 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:15.831636 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c1b101e0-75bf-4689-827e-05cd998d1658 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:15.831934 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1f1363f5-f0c3-4768-b135-023f7df19c1b tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:15.832374 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1f1363f5-f0c3-4768-b135-023f7df19c1b tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:15.833187 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1f1363f5-f0c3-4768-b135-023f7df19c1b tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:15.834169 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1f1363f5-f0c3-4768-b135-023f7df19c1b tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:16.119804 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-c1b101e0-75bf-4689-827e-05cd998d1658 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:52:16.131003 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-1f1363f5-f0c3-4768-b135-023f7df19c1b tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906e4bc4e9cc45ecb01cfca7918e461d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc215aadb5345d791945658832aae4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:52:16.139584 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-c1b101e0-75bf-4689-827e-05cd998d1658 tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/b7a76827-1907-4bf4-b27c-945b33b2316d" status: 200 len: 1522 microversion: 2.1 time: 0.323926 Jul 21 10:52:16.140371 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 374/758] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:52:15 2022] GET /compute/v2.1/servers/b7a76827-1907-4bf4-b27c-945b33b2316d => generated 1522 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:52:16.141453 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-1f1363f5-f0c3-4768-b135-023f7df19c1b tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/6803db4b-7556-4e4e-989c-adfa3d140a09" status: 200 len: 1680 microversion: 2.1 time: 0.320938 Jul 21 10:52:16.145131 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [req-2a17ac66-d194-447a-988d-7794d6fc811f req-85691bf9-3745-4af7-9f56-db0b17990028 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7a76827-1907-4bf4-b27c-945b33b2316d", "name": "network-vif-deleted", "tag": "19e030a0-d846-4c1c-bab7-3d45644c2248"}]} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:52:16.151541 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 385/759] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:52:15 2022] GET /compute/v2.1/servers/6803db4b-7556-4e4e-989c-adfa3d140a09 => generated 1680 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:52:16.155718 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-2a17ac66-d194-447a-988d-7794d6fc811f req-85691bf9-3745-4af7-9f56-db0b17990028 service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:16.156837 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-2a17ac66-d194-447a-988d-7794d6fc811f req-85691bf9-3745-4af7-9f56-db0b17990028 service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:16.169280 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.compute.server_external_events [req-2a17ac66-d194-447a-988d-7794d6fc811f req-85691bf9-3745-4af7-9f56-db0b17990028 service nova] Creating event network-vif-deleted:19e030a0-d846-4c1c-bab7-3d45644c2248 for instance b7a76827-1907-4bf4-b27c-945b33b2316d on hv-cinder-84980 Jul 21 10:52:16.174515 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [req-2a17ac66-d194-447a-988d-7794d6fc811f req-85691bf9-3745-4af7-9f56-db0b17990028 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032891 Jul 21 10:52:16.175529 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 375/760] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 21 10:52:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:52:17.120981 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [req-9914e25e-07f9-48e2-b897-c2c05bdea6e4 req-530c27ac-0178-4d08-a064-e55fb4ca1ea3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6803db4b-7556-4e4e-989c-adfa3d140a09", "name": "network-vif-deleted", "tag": "28698c15-1328-42b1-94dc-58f0f01666c1"}]} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:52:17.129432 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-9914e25e-07f9-48e2-b897-c2c05bdea6e4 req-530c27ac-0178-4d08-a064-e55fb4ca1ea3 service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:17.129870 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-9914e25e-07f9-48e2-b897-c2c05bdea6e4 req-530c27ac-0178-4d08-a064-e55fb4ca1ea3 service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:17.140543 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.compute.server_external_events [req-9914e25e-07f9-48e2-b897-c2c05bdea6e4 req-530c27ac-0178-4d08-a064-e55fb4ca1ea3 service nova] Creating event network-vif-deleted:28698c15-1328-42b1-94dc-58f0f01666c1 for instance 6803db4b-7556-4e4e-989c-adfa3d140a09 on hv-cinder-84980 Jul 21 10:52:17.145513 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [req-9914e25e-07f9-48e2-b897-c2c05bdea6e4 req-530c27ac-0178-4d08-a064-e55fb4ca1ea3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028175 Jul 21 10:52:17.146404 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 386/761] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 21 10:52:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:52:17.157296 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-ed9e9c85-9ed5-4a9a-89b5-28ed806b2c7f tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:52:17.158003 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-ed9e9c85-9ed5-4a9a-89b5-28ed806b2c7f tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: b7a76827-1907-4bf4-b27c-945b33b2316d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:52:17.161860 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-672cc104-d784-45dd-af70-089452fc6c53 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:52:17.162925 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-672cc104-d784-45dd-af70-089452fc6c53 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 6803db4b-7556-4e4e-989c-adfa3d140a09] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:52:17.167318 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ed9e9c85-9ed5-4a9a-89b5-28ed806b2c7f tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:17.167966 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ed9e9c85-9ed5-4a9a-89b5-28ed806b2c7f tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:17.169511 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ed9e9c85-9ed5-4a9a-89b5-28ed806b2c7f tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:17.170691 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ed9e9c85-9ed5-4a9a-89b5-28ed806b2c7f tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:17.173108 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-672cc104-d784-45dd-af70-089452fc6c53 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:17.173674 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-672cc104-d784-45dd-af70-089452fc6c53 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:17.174716 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-672cc104-d784-45dd-af70-089452fc6c53 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:17.175555 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-672cc104-d784-45dd-af70-089452fc6c53 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:17.231166 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ed9e9c85-9ed5-4a9a-89b5-28ed806b2c7f tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:17.232305 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ed9e9c85-9ed5-4a9a-89b5-28ed806b2c7f tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:17.233126 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.objects.instance [None req-ed9e9c85-9ed5-4a9a-89b5-28ed806b2c7f tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lazy-loading 'fault' on Instance uuid b7a76827-1907-4bf4-b27c-945b33b2316d {{(pid=124868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 10:52:17.247614 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-672cc104-d784-45dd-af70-089452fc6c53 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906e4bc4e9cc45ecb01cfca7918e461d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc215aadb5345d791945658832aae4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:52:17.259088 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-672cc104-d784-45dd-af70-089452fc6c53 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/6803db4b-7556-4e4e-989c-adfa3d140a09" status: 200 len: 1613 microversion: 2.1 time: 0.102461 Jul 21 10:52:17.270985 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 387/762] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:52:17 2022] GET /compute/v2.1/servers/6803db4b-7556-4e4e-989c-adfa3d140a09 => generated 1613 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:52:17.317778 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-ed9e9c85-9ed5-4a9a-89b5-28ed806b2c7f tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2cb1079722947dfa37946c03b7297a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff45af5bd82457b9fd080026ea65b5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:52:17.328118 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-ed9e9c85-9ed5-4a9a-89b5-28ed806b2c7f tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/b7a76827-1907-4bf4-b27c-945b33b2316d" status: 200 len: 1312 microversion: 2.1 time: 0.175344 Jul 21 10:52:17.329393 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 376/763] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:52:17 2022] GET /compute/v2.1/servers/b7a76827-1907-4bf4-b27c-945b33b2316d => generated 1312 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:52:18.277150 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-ec222b11-f2dc-4690-80f6-b9fe4d4bcffe tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:52:18.277967 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-ec222b11-f2dc-4690-80f6-b9fe4d4bcffe tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 6803db4b-7556-4e4e-989c-adfa3d140a09] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:52:18.284214 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ec222b11-f2dc-4690-80f6-b9fe4d4bcffe tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:18.284670 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ec222b11-f2dc-4690-80f6-b9fe4d4bcffe tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:18.285435 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ec222b11-f2dc-4690-80f6-b9fe4d4bcffe tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:18.285870 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ec222b11-f2dc-4690-80f6-b9fe4d4bcffe tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:18.318809 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ec222b11-f2dc-4690-80f6-b9fe4d4bcffe tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:18.319432 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ec222b11-f2dc-4690-80f6-b9fe4d4bcffe tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:18.319887 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.objects.instance [None req-ec222b11-f2dc-4690-80f6-b9fe4d4bcffe tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lazy-loading 'fault' on Instance uuid 6803db4b-7556-4e4e-989c-adfa3d140a09 {{(pid=124867) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 10:52:18.351929 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-de3c1851-36bf-43c3-a203-7ac116a9351c tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:52:18.352542 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-de3c1851-36bf-43c3-a203-7ac116a9351c tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] [instance: b7a76827-1907-4bf4-b27c-945b33b2316d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:52:18.354988 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_api:SELECT=68,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:52:18.361781 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-ec222b11-f2dc-4690-80f6-b9fe4d4bcffe tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906e4bc4e9cc45ecb01cfca7918e461d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc215aadb5345d791945658832aae4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:52:18.363817 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-de3c1851-36bf-43c3-a203-7ac116a9351c tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:18.364269 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-de3c1851-36bf-43c3-a203-7ac116a9351c tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:18.365039 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-de3c1851-36bf-43c3-a203-7ac116a9351c tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:18.365496 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-de3c1851-36bf-43c3-a203-7ac116a9351c tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:18.369062 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-ec222b11-f2dc-4690-80f6-b9fe4d4bcffe tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/6803db4b-7556-4e4e-989c-adfa3d140a09" status: 200 len: 1331 microversion: 2.1 time: 0.095762 Jul 21 10:52:18.369627 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 388/764] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:52:18 2022] GET /compute/v2.1/servers/6803db4b-7556-4e4e-989c-adfa3d140a09 => generated 1331 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:52:18.379112 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.wsgi [None req-de3c1851-36bf-43c3-a203-7ac116a9351c tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] HTTP exception thrown: Instance b7a76827-1907-4bf4-b27c-945b33b2316d could not be found. Jul 21 10:52:18.380742 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-de3c1851-36bf-43c3-a203-7ac116a9351c tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Request method failure captured: Jul 21 10:52:18.380742 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: request: GET /compute/v2.1/servers/b7a76827-1907-4bf4-b27c-945b33b2316d HTTP/1.1 Jul 21 10:52:18.380742 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Accept: application/json Jul 21 10:52:18.380742 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Accept-Encoding: identity Jul 21 10:52:18.380742 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Connection: close Jul 21 10:52:18.380742 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Content-Length: 0 Jul 21 10:52:18.380742 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Content-Type: application/json Jul 21 10:52:18.380742 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Host: 10.222.0.48 Jul 21 10:52:18.380742 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Openstack-System-Scope: None Jul 21 10:52:18.380742 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: User-Agent: python-urllib3/1.26.9 Jul 21 10:52:18.380742 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Auth-Token: gAAAAABi2S6Ceh_4nWphJ8VOdl6H8HFNXSa-qaDU7JzSMyQFmKOVC1-s9RjoIDnnf0b6XhBtJZfkFCZ33MTu8R7SDlIHJinmYsY2WkcMWq4PFgA7k0PzgcXzqdQyXpT96ot3T9mRIIjamqovKw8w4rfRBreiHT2xSl4dltciMM60bd0k4iI4qGs Jul 21 10:52:18.380742 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Domain-Id: None Jul 21 10:52:18.380742 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Domain-Name: None Jul 21 10:52:18.380742 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Identity-Status: Confirmed Jul 21 10:52:18.380742 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Is-Admin-Project: True Jul 21 10:52:18.380742 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Domain-Id: default Jul 21 10:52:18.380742 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Domain-Name: Default Jul 21 10:52:18.380742 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Id: 2ff45af5bd82457b9fd080026ea65b5b Jul 21 10:52:18.380742 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1176570364 Jul 21 10:52:18.380742 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Role: reader,member Jul 21 10:52:18.380742 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Roles: reader,member Jul 21 10:52:18.382343 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2ff45af5bd82457b9fd080026ea65b5b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2ff45af5bd82457b9fd080026ea65b5b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2ff45af5bd82457b9fd080026ea65b5b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2ff45af5bd82457b9fd080026ea65b5b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] Jul 21 10:52:18.382343 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1176570364 Jul 21 10:52:18.382343 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Tenant-Id: 2ff45af5bd82457b9fd080026ea65b5b Jul 21 10:52:18.382343 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1176570364 Jul 21 10:52:18.382343 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User: tempest-ServerRescueNegativeTestJSON-1176570364-project Jul 21 10:52:18.382343 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Domain-Id: default Jul 21 10:52:18.382343 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Domain-Name: Default Jul 21 10:52:18.382343 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Id: a2cb1079722947dfa37946c03b7297a3 Jul 21 10:52:18.382343 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1176570364-project Jul 21 10:52:18.382343 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: method: > Jul 21 10:52:18.382343 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: exception: Instance b7a76827-1907-4bf4-b27c-945b33b2316d could not be found. Jul 21 10:52:18.382343 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: action_args: {'id': 'b7a76827-1907-4bf4-b27c-945b33b2316d'} Jul 21 10:52:18.383246 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 10:52:18.383246 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:52:18.383246 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 10:52:18.383246 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 10:52:18.383246 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 10:52:18.383246 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 10:52:18.383246 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 10:52:18.383246 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 10:52:18.383246 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 10:52:18.383246 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 10:52:18.383246 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7a76827-1907-4bf4-b27c-945b33b2316d could not be found. Jul 21 10:52:18.383246 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:52:18.383246 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:52:18.383246 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:52:18.383246 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:52:18.383246 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:52:18.383246 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:52:18.383246 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 10:52:18.383246 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 10:52:18.383246 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 10:52:18.384711 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 10:52:18.384711 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 10:52:18.384711 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 10:52:18.384711 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 10:52:18.384711 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 10:52:18.384711 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 10:52:18.384711 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 10:52:18.384711 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7a76827-1907-4bf4-b27c-945b33b2316d could not be found. Jul 21 10:52:18.384711 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:52:18.384711 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:52:18.384711 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:52:18.384711 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:52:18.384711 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:52:18.384711 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:52:18.384711 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 10:52:18.384711 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 10:52:18.384711 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7a76827-1907-4bf4-b27c-945b33b2316d could not be found. Jul 21 10:52:18.384711 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:52:18.386061 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-de3c1851-36bf-43c3-a203-7ac116a9351c tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] Returning 404 to user: Instance b7a76827-1907-4bf4-b27c-945b33b2316d could not be found. {{(pid=124868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 10:52:18.386061 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-de3c1851-36bf-43c3-a203-7ac116a9351c tempest-ServerRescueNegativeTestJSON-1176570364 tempest-ServerRescueNegativeTestJSON-1176570364-project] 10.222.0.48 "GET /compute/v2.1/servers/b7a76827-1907-4bf4-b27c-945b33b2316d" status: 404 len: 111 microversion: 2.1 time: 0.034117 Jul 21 10:52:18.386061 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 377/765] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:52:18 2022] GET /compute/v2.1/servers/b7a76827-1907-4bf4-b27c-945b33b2316d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 21 10:52:19.386484 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-c652fc10-4a19-488d-b008-c9306c7f06e7 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:52:19.387832 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-c652fc10-4a19-488d-b008-c9306c7f06e7 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 6803db4b-7556-4e4e-989c-adfa3d140a09] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:52:19.394133 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c652fc10-4a19-488d-b008-c9306c7f06e7 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:19.394611 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c652fc10-4a19-488d-b008-c9306c7f06e7 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:19.395378 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c652fc10-4a19-488d-b008-c9306c7f06e7 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:19.395989 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c652fc10-4a19-488d-b008-c9306c7f06e7 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:19.412237 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.wsgi [None req-c652fc10-4a19-488d-b008-c9306c7f06e7 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] HTTP exception thrown: Instance 6803db4b-7556-4e4e-989c-adfa3d140a09 could not be found. Jul 21 10:52:19.413878 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-c652fc10-4a19-488d-b008-c9306c7f06e7 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Request method failure captured: Jul 21 10:52:19.413878 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: request: GET /compute/v2.1/servers/6803db4b-7556-4e4e-989c-adfa3d140a09 HTTP/1.1 Jul 21 10:52:19.413878 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Accept: application/json Jul 21 10:52:19.413878 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Accept-Encoding: identity Jul 21 10:52:19.413878 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Connection: close Jul 21 10:52:19.413878 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Content-Length: 0 Jul 21 10:52:19.413878 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Content-Type: application/json Jul 21 10:52:19.413878 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Host: 10.222.0.48 Jul 21 10:52:19.413878 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Openstack-System-Scope: None Jul 21 10:52:19.413878 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: User-Agent: python-urllib3/1.26.9 Jul 21 10:52:19.413878 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Auth-Token: gAAAAABi2S6IjD13fpvyB3gT_wfBhrxBWJW9IyP2Nfh-tKREma2qJlItcJifOI1FikOPoU86kC4jMPIUJv7c1XQEgHyn13RPV4dm8YXLpWP83NoB7MDue-0ef8jz1-9ETLoC72jgbX7x_bNoV_fia9kSfgVPDrqxya-pNvknwmV6TjdQwJPLki8 Jul 21 10:52:19.413878 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Domain-Id: None Jul 21 10:52:19.413878 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Domain-Name: None Jul 21 10:52:19.413878 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Identity-Status: Confirmed Jul 21 10:52:19.413878 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Is-Admin-Project: True Jul 21 10:52:19.413878 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Project-Domain-Id: default Jul 21 10:52:19.413878 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Project-Domain-Name: Default Jul 21 10:52:19.413878 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Project-Id: 0dc215aadb5345d791945658832aae4a Jul 21 10:52:19.413878 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Project-Name: tempest-AttachVolumeNegativeTest-692763952 Jul 21 10:52:19.413878 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Role: reader,member Jul 21 10:52:19.413878 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Roles: reader,member Jul 21 10:52:19.415464 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0dc215aadb5345d791945658832aae4a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0dc215aadb5345d791945658832aae4a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0dc215aadb5345d791945658832aae4a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0dc215aadb5345d791945658832aae4a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] Jul 21 10:52:19.415464 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Tenant: tempest-AttachVolumeNegativeTest-692763952 Jul 21 10:52:19.415464 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Tenant-Id: 0dc215aadb5345d791945658832aae4a Jul 21 10:52:19.415464 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-692763952 Jul 21 10:52:19.415464 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User: tempest-AttachVolumeNegativeTest-692763952-project Jul 21 10:52:19.415464 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User-Domain-Id: default Jul 21 10:52:19.415464 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User-Domain-Name: Default Jul 21 10:52:19.415464 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User-Id: 906e4bc4e9cc45ecb01cfca7918e461d Jul 21 10:52:19.415464 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User-Name: tempest-AttachVolumeNegativeTest-692763952-project Jul 21 10:52:19.415464 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: method: > Jul 21 10:52:19.415464 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: exception: Instance 6803db4b-7556-4e4e-989c-adfa3d140a09 could not be found. Jul 21 10:52:19.415464 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: action_args: {'id': '6803db4b-7556-4e4e-989c-adfa3d140a09'} Jul 21 10:52:19.416319 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 10:52:19.416319 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:52:19.416319 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 10:52:19.416319 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 10:52:19.416319 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 10:52:19.416319 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 10:52:19.416319 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 10:52:19.416319 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 10:52:19.416319 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 10:52:19.416319 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 10:52:19.416319 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6803db4b-7556-4e4e-989c-adfa3d140a09 could not be found. Jul 21 10:52:19.416319 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:52:19.416319 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:52:19.416319 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:52:19.416319 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:52:19.416319 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:52:19.416319 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:52:19.416319 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 10:52:19.416319 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 10:52:19.416319 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 10:52:19.417726 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 10:52:19.417726 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 10:52:19.417726 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 10:52:19.417726 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 10:52:19.417726 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 10:52:19.417726 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 10:52:19.417726 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 10:52:19.417726 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6803db4b-7556-4e4e-989c-adfa3d140a09 could not be found. Jul 21 10:52:19.417726 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:52:19.417726 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:52:19.417726 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:52:19.417726 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:52:19.417726 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:52:19.417726 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:52:19.417726 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 10:52:19.417726 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 10:52:19.417726 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6803db4b-7556-4e4e-989c-adfa3d140a09 could not be found. Jul 21 10:52:19.417726 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:52:19.419698 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-c652fc10-4a19-488d-b008-c9306c7f06e7 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Returning 404 to user: Instance 6803db4b-7556-4e4e-989c-adfa3d140a09 could not be found. {{(pid=124867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 10:52:19.419698 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-c652fc10-4a19-488d-b008-c9306c7f06e7 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/6803db4b-7556-4e4e-989c-adfa3d140a09" status: 404 len: 111 microversion: 2.1 time: 0.032695 Jul 21 10:52:19.419698 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 389/766] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:52:19 2022] GET /compute/v2.1/servers/6803db4b-7556-4e4e-989c-adfa3d140a09 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 10:52:19.425245 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-0f308d0b-0de1-4d94-8291-b57b948551cb tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '.version_select at 0x7f7962931820>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:52:19.522519 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-0f308d0b-0de1-4d94-8291-b57b948551cb tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1959860331" status: 202 len: 0 microversion: 2.1 time: 0.101456 Jul 21 10:52:19.523128 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 378/767] 10.222.0.48 () {58 vars in 1220 bytes} [Thu Jul 21 10:52:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1959860331 => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 10:52:20.423935 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-11a93d28-80a2-4a40-88a6-b28c43dfc34f tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Action: 'create', calling method: .version_select at 0x7f795eaedca0>, body: {"keypair": {"name": "tempest-keypair-1042340688", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNTXhhOEiWoI32yhC9dZTYtRJRpE6IXfg+3HmfjYaD1ZzUcwXkLBw3XEkNH+kSAK2abJTyW+8lozvVoRNPkk9P28GAjmk7gYIA8UPl7h/d6PDNr+7hC2htsTSg2EMU28Wg=="}} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:52:20.442976 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.quota [None req-11a93d28-80a2-4a40-88a6-b28c43dfc34f tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Getting quotas for project 0dc215aadb5345d791945658832aae4a. Resources: {'key_pairs'} {{(pid=124867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 10:52:20.444631 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.quota [None req-11a93d28-80a2-4a40-88a6-b28c43dfc34f tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Getting quotas for user 906e4bc4e9cc45ecb01cfca7918e461d and project 0dc215aadb5345d791945658832aae4a. Resources: {'key_pairs'} {{(pid=124867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 10:52:20.522352 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-11a93d28-80a2-4a40-88a6-b28c43dfc34f tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.102207 Jul 21 10:52:20.529278 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 390/768] 10.222.0.48 () {60 vars in 1158 bytes} [Thu Jul 21 10:52:20 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:52:23.434333 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-f128b8bf-5834-4bc8-b4e1-d41e8c840ba7 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1010850342", "imageRef": "282ddb30-fa0f-489d-9cc3-a3e70e03c631", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "192d6a0f-c1f8-471a-872f-e924c6d8f479"}], "security_groups": [{"name": "tempest-securitygroup--139094573"}], "key_name": "tempest-keypair-1042340688", "user_data": "}} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:52:23.538730 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.network.neutron [None req-f128b8bf-5834-4bc8-b4e1-d41e8c840ba7 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] validate_networks() for [('192d6a0f-c1f8-471a-872f-e924c6d8f479', None, None, None, None, None)] {{(pid=124868) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 10:52:24.024743 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.virt.hardware [None req-f128b8bf-5834-4bc8-b4e1-d41e8c840ba7 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Flavor limits 0:0:0 {{(pid=124868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 10:52:24.025162 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.virt.hardware [None req-f128b8bf-5834-4bc8-b4e1-d41e8c840ba7 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Image limits 0:0:0 {{(pid=124868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 10:52:24.025628 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.virt.hardware [None req-f128b8bf-5834-4bc8-b4e1-d41e8c840ba7 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Flavor pref 0:0:0 {{(pid=124868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 10:52:24.026029 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.virt.hardware [None req-f128b8bf-5834-4bc8-b4e1-d41e8c840ba7 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Image pref 0:0:0 {{(pid=124868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 10:52:24.026464 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.virt.hardware [None req-f128b8bf-5834-4bc8-b4e1-d41e8c840ba7 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 10:52:24.035680 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f128b8bf-5834-4bc8-b4e1-d41e8c840ba7 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:24.036118 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f128b8bf-5834-4bc8-b4e1-d41e8c840ba7 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:24.036903 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f128b8bf-5834-4bc8-b4e1-d41e8c840ba7 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:24.037324 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f128b8bf-5834-4bc8-b4e1-d41e8c840ba7 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:24.054241 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.quota [None req-f128b8bf-5834-4bc8-b4e1-d41e8c840ba7 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Getting quotas for project 0dc215aadb5345d791945658832aae4a. Resources: {'ram', 'instances', 'cores'} {{(pid=124868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 10:52:24.058281 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.quota [None req-f128b8bf-5834-4bc8-b4e1-d41e8c840ba7 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Getting quotas for user 906e4bc4e9cc45ecb01cfca7918e461d and project 0dc215aadb5345d791945658832aae4a. Resources: {'ram', 'instances', 'cores'} {{(pid=124868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 10:52:24.070747 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-f128b8bf-5834-4bc8-b4e1-d41e8c840ba7 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Going to run 1 instances... {{(pid=124868) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 10:52:24.072981 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-f128b8bf-5834-4bc8-b4e1-d41e8c840ba7 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 1457b868-0630-42f6-958c-da6d5bbab2ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='282ddb30-fa0f-489d-9cc3-a3e70e03c631',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 10:52:24.176091 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-f128b8bf-5834-4bc8-b4e1-d41e8c840ba7 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.749833 Jul 21 10:52:24.176662 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 379/769] 10.222.0.48 () {60 vars in 1146 bytes} [Thu Jul 21 10:52:23 2022] POST /compute/v2.1/servers => generated 401 bytes in 751 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 10:52:24.190133 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-ce24b81b-7ca1-4a07-9547-4b986a2b2a33 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:52:24.190133 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-ce24b81b-7ca1-4a07-9547-4b986a2b2a33 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 1457b868-0630-42f6-958c-da6d5bbab2ce] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:52:24.255147 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-ce24b81b-7ca1-4a07-9547-4b986a2b2a33 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906e4bc4e9cc45ecb01cfca7918e461d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc215aadb5345d791945658832aae4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:52:24.263319 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-ce24b81b-7ca1-4a07-9547-4b986a2b2a33 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/1457b868-0630-42f6-958c-da6d5bbab2ce" status: 200 len: 1242 microversion: 2.1 time: 0.080377 Jul 21 10:52:24.263875 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 391/770] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:52:24 2022] GET /compute/v2.1/servers/1457b868-0630-42f6-958c-da6d5bbab2ce => generated 1242 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:52:25.280597 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-f2e5028b-dfa4-4680-bd6c-76e9f72db7c9 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:52:25.281167 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-f2e5028b-dfa4-4680-bd6c-76e9f72db7c9 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 1457b868-0630-42f6-958c-da6d5bbab2ce] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:52:25.288457 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f2e5028b-dfa4-4680-bd6c-76e9f72db7c9 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:25.288899 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f2e5028b-dfa4-4680-bd6c-76e9f72db7c9 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:25.289662 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f2e5028b-dfa4-4680-bd6c-76e9f72db7c9 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:25.290189 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f2e5028b-dfa4-4680-bd6c-76e9f72db7c9 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:25.352290 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-f2e5028b-dfa4-4680-bd6c-76e9f72db7c9 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906e4bc4e9cc45ecb01cfca7918e461d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc215aadb5345d791945658832aae4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:52:25.360302 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-f2e5028b-dfa4-4680-bd6c-76e9f72db7c9 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/1457b868-0630-42f6-958c-da6d5bbab2ce" status: 200 len: 1246 microversion: 2.1 time: 0.083853 Jul 21 10:52:25.360879 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 380/771] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:52:25 2022] GET /compute/v2.1/servers/1457b868-0630-42f6-958c-da6d5bbab2ce => generated 1246 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:52:26.377799 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-023f4aa8-e16a-429d-aa8a-07cc29059daa tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:52:26.378456 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-023f4aa8-e16a-429d-aa8a-07cc29059daa tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 1457b868-0630-42f6-958c-da6d5bbab2ce] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:52:26.384885 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-023f4aa8-e16a-429d-aa8a-07cc29059daa tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:26.385339 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-023f4aa8-e16a-429d-aa8a-07cc29059daa tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:26.386112 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-023f4aa8-e16a-429d-aa8a-07cc29059daa tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:26.386640 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-023f4aa8-e16a-429d-aa8a-07cc29059daa tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:26.449862 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-023f4aa8-e16a-429d-aa8a-07cc29059daa tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906e4bc4e9cc45ecb01cfca7918e461d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc215aadb5345d791945658832aae4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:52:26.457673 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-023f4aa8-e16a-429d-aa8a-07cc29059daa tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/1457b868-0630-42f6-958c-da6d5bbab2ce" status: 200 len: 1302 microversion: 2.1 time: 0.083690 Jul 21 10:52:26.458252 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 392/772] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:52:26 2022] GET /compute/v2.1/servers/1457b868-0630-42f6-958c-da6d5bbab2ce => generated 1302 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:52:27.475901 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-d8984783-dbf5-4a20-a63a-e051ab65fb57 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:52:27.476518 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-d8984783-dbf5-4a20-a63a-e051ab65fb57 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 1457b868-0630-42f6-958c-da6d5bbab2ce] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:52:27.483390 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d8984783-dbf5-4a20-a63a-e051ab65fb57 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:27.483841 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d8984783-dbf5-4a20-a63a-e051ab65fb57 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:27.484615 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d8984783-dbf5-4a20-a63a-e051ab65fb57 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:27.485084 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d8984783-dbf5-4a20-a63a-e051ab65fb57 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:27.670852 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-d8984783-dbf5-4a20-a63a-e051ab65fb57 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906e4bc4e9cc45ecb01cfca7918e461d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc215aadb5345d791945658832aae4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:52:27.678637 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-d8984783-dbf5-4a20-a63a-e051ab65fb57 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/1457b868-0630-42f6-958c-da6d5bbab2ce" status: 200 len: 1367 microversion: 2.1 time: 0.206545 Jul 21 10:52:27.679204 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 381/773] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:52:27 2022] GET /compute/v2.1/servers/1457b868-0630-42f6-958c-da6d5bbab2ce => generated 1367 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:52:28.284059 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [req-08f69e0b-7a68-4989-881d-b96edf38f1c9 req-c73b11e0-7c19-4f89-b87b-982214cee13b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1457b868-0630-42f6-958c-da6d5bbab2ce", "tag": "5e6868c7-2e19-4c0b-b436-ff20ce312453"}]} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:52:28.296835 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-08f69e0b-7a68-4989-881d-b96edf38f1c9 req-c73b11e0-7c19-4f89-b87b-982214cee13b service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:28.297299 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-08f69e0b-7a68-4989-881d-b96edf38f1c9 req-c73b11e0-7c19-4f89-b87b-982214cee13b service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:28.315006 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.compute.server_external_events [req-08f69e0b-7a68-4989-881d-b96edf38f1c9 req-c73b11e0-7c19-4f89-b87b-982214cee13b service nova] Creating event network-changed:5e6868c7-2e19-4c0b-b436-ff20ce312453 for instance 1457b868-0630-42f6-958c-da6d5bbab2ce on hv-cinder-84980 Jul 21 10:52:28.320770 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [req-08f69e0b-7a68-4989-881d-b96edf38f1c9 req-c73b11e0-7c19-4f89-b87b-982214cee13b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041613 Jul 21 10:52:28.321458 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 393/774] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 21 10:52:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:52:28.697447 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-9d31ff21-2bd0-4104-84e6-ce556f1fc7ee tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:52:28.698048 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-9d31ff21-2bd0-4104-84e6-ce556f1fc7ee tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 1457b868-0630-42f6-958c-da6d5bbab2ce] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:52:28.707866 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9d31ff21-2bd0-4104-84e6-ce556f1fc7ee tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:28.708321 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9d31ff21-2bd0-4104-84e6-ce556f1fc7ee tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:28.709092 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9d31ff21-2bd0-4104-84e6-ce556f1fc7ee tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:28.709553 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9d31ff21-2bd0-4104-84e6-ce556f1fc7ee tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:28.868856 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-9d31ff21-2bd0-4104-84e6-ce556f1fc7ee tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906e4bc4e9cc45ecb01cfca7918e461d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc215aadb5345d791945658832aae4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:52:28.877166 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-9d31ff21-2bd0-4104-84e6-ce556f1fc7ee tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/1457b868-0630-42f6-958c-da6d5bbab2ce" status: 200 len: 1367 microversion: 2.1 time: 0.183949 Jul 21 10:52:28.877735 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 382/775] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:52:28 2022] GET /compute/v2.1/servers/1457b868-0630-42f6-958c-da6d5bbab2ce => generated 1367 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:52:29.896119 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-69ba0bee-5f7e-42c2-88a9-f5f688a694f1 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:52:29.896797 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-69ba0bee-5f7e-42c2-88a9-f5f688a694f1 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 1457b868-0630-42f6-958c-da6d5bbab2ce] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:52:29.903576 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-69ba0bee-5f7e-42c2-88a9-f5f688a694f1 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:29.904014 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-69ba0bee-5f7e-42c2-88a9-f5f688a694f1 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:29.904772 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-69ba0bee-5f7e-42c2-88a9-f5f688a694f1 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:29.905196 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-69ba0bee-5f7e-42c2-88a9-f5f688a694f1 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:30.043332 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-69ba0bee-5f7e-42c2-88a9-f5f688a694f1 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906e4bc4e9cc45ecb01cfca7918e461d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc215aadb5345d791945658832aae4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:52:30.050807 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-69ba0bee-5f7e-42c2-88a9-f5f688a694f1 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/1457b868-0630-42f6-958c-da6d5bbab2ce" status: 200 len: 1367 microversion: 2.1 time: 0.159329 Jul 21 10:52:30.054625 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 394/776] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:52:29 2022] GET /compute/v2.1/servers/1457b868-0630-42f6-958c-da6d5bbab2ce => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:52:31.070711 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-f99bd96d-cb4e-4979-a17b-d792ee329c8b tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:52:31.071315 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-f99bd96d-cb4e-4979-a17b-d792ee329c8b tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 1457b868-0630-42f6-958c-da6d5bbab2ce] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:52:31.079959 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f99bd96d-cb4e-4979-a17b-d792ee329c8b tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:31.080285 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f99bd96d-cb4e-4979-a17b-d792ee329c8b tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:31.081226 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f99bd96d-cb4e-4979-a17b-d792ee329c8b tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:31.081655 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f99bd96d-cb4e-4979-a17b-d792ee329c8b tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:31.084454 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-44b6de58-8a8a-41b8-a8fe-502a682e2968 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1818826965"}} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:52:31.085024 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-44b6de58-8a8a-41b8-a8fe-502a682e2968 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] [instance: 6597f555-38e1-4d14-bf7c-6d8b5e5a26d4] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:52:31.091555 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-44b6de58-8a8a-41b8-a8fe-502a682e2968 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:31.092003 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-44b6de58-8a8a-41b8-a8fe-502a682e2968 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:31.092767 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-44b6de58-8a8a-41b8-a8fe-502a682e2968 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:31.093208 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-44b6de58-8a8a-41b8-a8fe-502a682e2968 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:31.303266 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-f99bd96d-cb4e-4979-a17b-d792ee329c8b tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906e4bc4e9cc45ecb01cfca7918e461d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc215aadb5345d791945658832aae4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:52:31.310151 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.network.security_group_api [None req-44b6de58-8a8a-41b8-a8fe-502a682e2968 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Removing security group c5ee5c4d-66ab-4d3f-a7cf-6badf584244d from port 24113ecd-45f8-473c-a1aa-fc93cff6c402 Jul 21 10:52:31.311739 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-f99bd96d-cb4e-4979-a17b-d792ee329c8b tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/1457b868-0630-42f6-958c-da6d5bbab2ce" status: 200 len: 1367 microversion: 2.1 time: 0.244866 Jul 21 10:52:31.312319 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 383/777] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:52:31 2022] GET /compute/v2.1/servers/1457b868-0630-42f6-958c-da6d5bbab2ce => generated 1367 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:52:31.721450 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-44b6de58-8a8a-41b8-a8fe-502a682e2968 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] 10.222.0.48 "POST /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4/action" status: 202 len: 0 microversion: 2.1 time: 0.641450 Jul 21 10:52:31.726238 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 395/778] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 21 10:52:31 2022] POST /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4/action => generated 0 bytes in 647 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 21 10:52:31.732181 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [req-8cf1dedf-3e0c-4f79-9b0b-b5176b687a32 req-5c4ac485-6444-43f7-8bc2-f43ec5ac32ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6597f555-38e1-4d14-bf7c-6d8b5e5a26d4", "tag": "24113ecd-45f8-473c-a1aa-fc93cff6c402"}]} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:52:31.750699 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-8cf1dedf-3e0c-4f79-9b0b-b5176b687a32 req-5c4ac485-6444-43f7-8bc2-f43ec5ac32ec service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:31.751690 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-8cf1dedf-3e0c-4f79-9b0b-b5176b687a32 req-5c4ac485-6444-43f7-8bc2-f43ec5ac32ec service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:31.778490 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.compute.server_external_events [req-8cf1dedf-3e0c-4f79-9b0b-b5176b687a32 req-5c4ac485-6444-43f7-8bc2-f43ec5ac32ec service nova] Creating event network-changed:24113ecd-45f8-473c-a1aa-fc93cff6c402 for instance 6597f555-38e1-4d14-bf7c-6d8b5e5a26d4 on hv-cinder-84980 Jul 21 10:52:31.786482 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [req-8cf1dedf-3e0c-4f79-9b0b-b5176b687a32 req-5c4ac485-6444-43f7-8bc2-f43ec5ac32ec service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060885 Jul 21 10:52:31.787898 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 384/779] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 21 10:52:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 10:52:32.329536 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-d6e01923-c118-4ed4-9466-84b0fc3c57aa tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:52:32.330745 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-d6e01923-c118-4ed4-9466-84b0fc3c57aa tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 1457b868-0630-42f6-958c-da6d5bbab2ce] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:52:32.338027 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d6e01923-c118-4ed4-9466-84b0fc3c57aa tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:32.338791 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d6e01923-c118-4ed4-9466-84b0fc3c57aa tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:32.340083 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d6e01923-c118-4ed4-9466-84b0fc3c57aa tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:32.340677 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d6e01923-c118-4ed4-9466-84b0fc3c57aa tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:32.365313 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:52:32.588387 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-d6e01923-c118-4ed4-9466-84b0fc3c57aa tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906e4bc4e9cc45ecb01cfca7918e461d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc215aadb5345d791945658832aae4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:52:32.596790 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-d6e01923-c118-4ed4-9466-84b0fc3c57aa tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/1457b868-0630-42f6-958c-da6d5bbab2ce" status: 200 len: 1367 microversion: 2.1 time: 0.271465 Jul 21 10:52:32.600486 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 396/780] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:52:32 2022] GET /compute/v2.1/servers/1457b868-0630-42f6-958c-da6d5bbab2ce => generated 1367 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:52:33.337094 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-8f004903-3d85-40c4-89ff-f97590c1c622 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:52:33.338563 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-8f004903-3d85-40c4-89ff-f97590c1c622 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] [instance: 6597f555-38e1-4d14-bf7c-6d8b5e5a26d4] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:52:33.344346 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8f004903-3d85-40c4-89ff-f97590c1c622 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:33.344792 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8f004903-3d85-40c4-89ff-f97590c1c622 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:33.345548 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8f004903-3d85-40c4-89ff-f97590c1c622 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:33.346065 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8f004903-3d85-40c4-89ff-f97590c1c622 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:33.430156 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.objects.instance [None req-8f004903-3d85-40c4-89ff-f97590c1c622 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lazy-loading 'services' on Instance uuid 6597f555-38e1-4d14-bf7c-6d8b5e5a26d4 {{(pid=124868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 10:52:33.616911 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-9453fc65-84d1-4347-8f16-5813f826831f tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:52:33.617646 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-9453fc65-84d1-4347-8f16-5813f826831f tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 1457b868-0630-42f6-958c-da6d5bbab2ce] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:52:33.626283 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9453fc65-84d1-4347-8f16-5813f826831f tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:33.626762 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9453fc65-84d1-4347-8f16-5813f826831f tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:33.627795 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9453fc65-84d1-4347-8f16-5813f826831f tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:33.628242 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9453fc65-84d1-4347-8f16-5813f826831f tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:33.629944 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-8f004903-3d85-40c4-89ff-f97590c1c622 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] 10.222.0.48 "DELETE /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4/os-volume_attachments/eae9be38-e38e-4e52-accb-d0ba35b74567" status: 202 len: 0 microversion: 2.1 time: 0.297229 Jul 21 10:52:33.631087 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 385/781] 10.222.0.48 () {58 vars in 1415 bytes} [Thu Jul 21 10:52:33 2022] DELETE /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4/os-volume_attachments/eae9be38-e38e-4e52-accb-d0ba35b74567 => generated 0 bytes in 299 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 10:52:33.650424 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-23d775b3-1163-4379-aef2-369518138f4d tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:52:33.652505 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-23d775b3-1163-4379-aef2-369518138f4d tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] [instance: 6597f555-38e1-4d14-bf7c-6d8b5e5a26d4] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:52:33.658956 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-23d775b3-1163-4379-aef2-369518138f4d tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:33.659434 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-23d775b3-1163-4379-aef2-369518138f4d tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:33.660382 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-23d775b3-1163-4379-aef2-369518138f4d tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:33.660821 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-23d775b3-1163-4379-aef2-369518138f4d tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:33.692952 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-23d775b3-1163-4379-aef2-369518138f4d tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] 10.222.0.48 "GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057294 Jul 21 10:52:33.697792 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 386/782] 10.222.0.48 () {58 vars in 1301 bytes} [Thu Jul 21 10:52:33 2022] GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:52:33.771536 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-9453fc65-84d1-4347-8f16-5813f826831f tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906e4bc4e9cc45ecb01cfca7918e461d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc215aadb5345d791945658832aae4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:52:33.782695 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-9453fc65-84d1-4347-8f16-5813f826831f tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/1457b868-0630-42f6-958c-da6d5bbab2ce" status: 200 len: 1367 microversion: 2.1 time: 0.169307 Jul 21 10:52:33.783422 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 397/783] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:52:33 2022] GET /compute/v2.1/servers/1457b868-0630-42f6-958c-da6d5bbab2ce => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:52:33.804680 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [req-5de49f2e-bc10-4e67-993e-905587328179 req-4557941b-d567-4c02-be31-ead9249526a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6597f555-38e1-4d14-bf7c-6d8b5e5a26d4", "tag": "24113ecd-45f8-473c-a1aa-fc93cff6c402"}]} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:52:33.813840 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-5de49f2e-bc10-4e67-993e-905587328179 req-4557941b-d567-4c02-be31-ead9249526a8 service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:33.814715 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-5de49f2e-bc10-4e67-993e-905587328179 req-4557941b-d567-4c02-be31-ead9249526a8 service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:33.828543 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.compute.server_external_events [req-5de49f2e-bc10-4e67-993e-905587328179 req-4557941b-d567-4c02-be31-ead9249526a8 service nova] Creating event network-changed:24113ecd-45f8-473c-a1aa-fc93cff6c402 for instance 6597f555-38e1-4d14-bf7c-6d8b5e5a26d4 on hv-cinder-84980 Jul 21 10:52:33.833449 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [req-5de49f2e-bc10-4e67-993e-905587328179 req-4557941b-d567-4c02-be31-ead9249526a8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033593 Jul 21 10:52:33.834202 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 387/784] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 21 10:52:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:52:34.508232 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell0:SELECT=6 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:52:34.649416 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [req-8d5e2ba5-34b0-4385-9c27-736e17819c4a req-20f9c91d-c113-474b-87bd-6d6cd2c1813c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1457b868-0630-42f6-958c-da6d5bbab2ce", "name": "network-vif-plugged", "status": "completed", "tag": "5e6868c7-2e19-4c0b-b436-ff20ce312453"}]} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:52:34.653705 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:52:34.659067 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-8d5e2ba5-34b0-4385-9c27-736e17819c4a req-20f9c91d-c113-474b-87bd-6d6cd2c1813c service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:34.659504 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-8d5e2ba5-34b0-4385-9c27-736e17819c4a req-20f9c91d-c113-474b-87bd-6d6cd2c1813c service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:34.673906 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.compute.server_external_events [req-8d5e2ba5-34b0-4385-9c27-736e17819c4a req-20f9c91d-c113-474b-87bd-6d6cd2c1813c service nova] Creating event network-vif-plugged:5e6868c7-2e19-4c0b-b436-ff20ce312453 for instance 1457b868-0630-42f6-958c-da6d5bbab2ce on hv-cinder-84980 Jul 21 10:52:34.678939 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [req-8d5e2ba5-34b0-4385-9c27-736e17819c4a req-20f9c91d-c113-474b-87bd-6d6cd2c1813c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.174996 Jul 21 10:52:34.679536 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 398/785] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 21 10:52:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:52:34.702829 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell0:SELECT=2 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:52:34.703546 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell0:SELECT=6 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:52:34.708491 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-05cac6cb-29dd-489f-a3ca-afd9f4b7f802 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:52:34.709517 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-05cac6cb-29dd-489f-a3ca-afd9f4b7f802 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] [instance: 6597f555-38e1-4d14-bf7c-6d8b5e5a26d4] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:52:34.716457 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-05cac6cb-29dd-489f-a3ca-afd9f4b7f802 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:34.716696 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-05cac6cb-29dd-489f-a3ca-afd9f4b7f802 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:34.717661 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-05cac6cb-29dd-489f-a3ca-afd9f4b7f802 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:34.718335 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-05cac6cb-29dd-489f-a3ca-afd9f4b7f802 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:34.734068 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:52:34.753554 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-05cac6cb-29dd-489f-a3ca-afd9f4b7f802 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] 10.222.0.48 "GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051776 Jul 21 10:52:34.754378 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 388/786] 10.222.0.48 () {58 vars in 1301 bytes} [Thu Jul 21 10:52:34 2022] GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:52:34.800590 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-2359eede-2d24-4eee-a0d2-2ba0cdc0c430 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:52:34.801575 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-2359eede-2d24-4eee-a0d2-2ba0cdc0c430 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 1457b868-0630-42f6-958c-da6d5bbab2ce] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:52:34.808946 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2359eede-2d24-4eee-a0d2-2ba0cdc0c430 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:34.809750 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2359eede-2d24-4eee-a0d2-2ba0cdc0c430 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:34.810527 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2359eede-2d24-4eee-a0d2-2ba0cdc0c430 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:34.810991 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2359eede-2d24-4eee-a0d2-2ba0cdc0c430 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:34.945046 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-2359eede-2d24-4eee-a0d2-2ba0cdc0c430 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906e4bc4e9cc45ecb01cfca7918e461d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc215aadb5345d791945658832aae4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:52:34.955704 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-2359eede-2d24-4eee-a0d2-2ba0cdc0c430 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/1457b868-0630-42f6-958c-da6d5bbab2ce" status: 200 len: 1367 microversion: 2.1 time: 0.157663 Jul 21 10:52:34.955704 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 399/787] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:52:34 2022] GET /compute/v2.1/servers/1457b868-0630-42f6-958c-da6d5bbab2ce => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:52:35.767030 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-45845b24-5467-473c-9f48-2816fbfd35d3 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:52:35.767955 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-45845b24-5467-473c-9f48-2816fbfd35d3 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] [instance: 6597f555-38e1-4d14-bf7c-6d8b5e5a26d4] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:52:35.776165 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-45845b24-5467-473c-9f48-2816fbfd35d3 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:35.776642 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-45845b24-5467-473c-9f48-2816fbfd35d3 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:35.777276 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-45845b24-5467-473c-9f48-2816fbfd35d3 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:35.778470 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-45845b24-5467-473c-9f48-2816fbfd35d3 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:35.806635 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-45845b24-5467-473c-9f48-2816fbfd35d3 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] 10.222.0.48 "GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045137 Jul 21 10:52:35.807192 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 389/788] 10.222.0.48 () {58 vars in 1301 bytes} [Thu Jul 21 10:52:35 2022] GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 21 10:52:35.817004 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-f76c647e-5ab7-479a-acbb-d22efe1ee467 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:52:35.817523 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-f76c647e-5ab7-479a-acbb-d22efe1ee467 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] [instance: 6597f555-38e1-4d14-bf7c-6d8b5e5a26d4] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:52:35.824565 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f76c647e-5ab7-479a-acbb-d22efe1ee467 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:35.825009 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f76c647e-5ab7-479a-acbb-d22efe1ee467 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:35.825777 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f76c647e-5ab7-479a-acbb-d22efe1ee467 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:35.826215 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f76c647e-5ab7-479a-acbb-d22efe1ee467 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:35.904041 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.wsgi [None req-f76c647e-5ab7-479a-acbb-d22efe1ee467 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] HTTP exception thrown: Instance 6597f555-38e1-4d14-bf7c-6d8b5e5a26d4 is not attached to volume eae9be38-e38e-4e52-accb-d0ba35b74567 Jul 21 10:52:35.906367 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-f76c647e-5ab7-479a-acbb-d22efe1ee467 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Request method failure captured: Jul 21 10:52:35.906367 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: request: DELETE /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4/os-volume_attachments/eae9be38-e38e-4e52-accb-d0ba35b74567 HTTP/1.1 Jul 21 10:52:35.906367 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Accept: application/json Jul 21 10:52:35.906367 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Accept-Encoding: identity Jul 21 10:52:35.906367 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Connection: close Jul 21 10:52:35.906367 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Content-Length: 0 Jul 21 10:52:35.906367 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Content-Type: application/json Jul 21 10:52:35.906367 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Host: 10.222.0.48 Jul 21 10:52:35.906367 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Openstack-System-Scope: None Jul 21 10:52:35.906367 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: User-Agent: python-urllib3/1.26.9 Jul 21 10:52:35.906367 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Auth-Token: gAAAAABi2S85SN4vx5Y5i_GT0TBc0w4J_cTYA85eiudq3RsShsf6cZmVF_DbYTR7ICDEvnXujyRqZJ-nwC3usk9fNcEwpPCYEZddQgRlF8AERckDd1P3xN5cEPXGkx3y5_wG6ZTImVBMmKft2Lj5BrO-T-PFQ8LkAIvJqM9sBjWeidGzMs6JeQY Jul 21 10:52:35.906367 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Domain-Id: None Jul 21 10:52:35.906367 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Domain-Name: None Jul 21 10:52:35.906367 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Identity-Status: Confirmed Jul 21 10:52:35.906367 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Is-Admin-Project: True Jul 21 10:52:35.906367 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Project-Domain-Id: default Jul 21 10:52:35.906367 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Project-Domain-Name: Default Jul 21 10:52:35.906367 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Project-Id: 2eff05785bd84522ad637d8bed14563d Jul 21 10:52:35.906367 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Project-Name: tempest-TestMinimumBasicScenario-1018116383 Jul 21 10:52:35.906367 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Role: reader,member Jul 21 10:52:35.906367 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Roles: reader,member Jul 21 10:52:35.907980 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2eff05785bd84522ad637d8bed14563d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2eff05785bd84522ad637d8bed14563d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2eff05785bd84522ad637d8bed14563d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2eff05785bd84522ad637d8bed14563d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] Jul 21 10:52:35.907980 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Tenant: tempest-TestMinimumBasicScenario-1018116383 Jul 21 10:52:35.907980 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Tenant-Id: 2eff05785bd84522ad637d8bed14563d Jul 21 10:52:35.907980 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1018116383 Jul 21 10:52:35.907980 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User: tempest-TestMinimumBasicScenario-1018116383-project Jul 21 10:52:35.907980 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User-Domain-Id: default Jul 21 10:52:35.907980 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User-Domain-Name: Default Jul 21 10:52:35.907980 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User-Id: 4ae0271efe4b4e9592b29d9f124519b7 Jul 21 10:52:35.907980 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User-Name: tempest-TestMinimumBasicScenario-1018116383-project Jul 21 10:52:35.907980 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: method: > Jul 21 10:52:35.907980 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: exception: Instance 6597f555-38e1-4d14-bf7c-6d8b5e5a26d4 is not attached to volume eae9be38-e38e-4e52-accb-d0ba35b74567 Jul 21 10:52:35.908778 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: action_args: {'server_id': '6597f555-38e1-4d14-bf7c-6d8b5e5a26d4', 'id': 'eae9be38-e38e-4e52-accb-d0ba35b74567'} Jul 21 10:52:35.908778 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 10:52:35.908778 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:52:35.908778 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 21 10:52:35.908778 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 21 10:52:35.908778 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 21 10:52:35.908778 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 21 10:52:35.908778 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 21 10:52:35.908778 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 21 10:52:35.908778 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id eae9be38-e38e-4e52-accb-d0ba35b74567. Jul 21 10:52:35.908778 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:52:35.908778 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:52:35.908778 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:52:35.908778 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:52:35.908778 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:52:35.908778 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:52:35.908778 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 10:52:35.908778 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 10:52:35.908778 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 10:52:35.910065 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 10:52:35.910065 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 21 10:52:35.910065 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 21 10:52:35.910065 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6597f555-38e1-4d14-bf7c-6d8b5e5a26d4 is not attached to volume eae9be38-e38e-4e52-accb-d0ba35b74567 Jul 21 10:52:35.910065 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:52:35.910065 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:52:35.910065 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:52:35.910065 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:52:35.910065 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:52:35.910065 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:52:35.910065 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 10:52:35.910065 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 10:52:35.910065 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6597f555-38e1-4d14-bf7c-6d8b5e5a26d4 is not attached to volume eae9be38-e38e-4e52-accb-d0ba35b74567 Jul 21 10:52:35.910065 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:52:35.910065 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-f76c647e-5ab7-479a-acbb-d22efe1ee467 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Returning 404 to user: Instance 6597f555-38e1-4d14-bf7c-6d8b5e5a26d4 is not attached to volume eae9be38-e38e-4e52-accb-d0ba35b74567 {{(pid=124867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 10:52:35.911359 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-f76c647e-5ab7-479a-acbb-d22efe1ee467 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] 10.222.0.48 "DELETE /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4/os-volume_attachments/eae9be38-e38e-4e52-accb-d0ba35b74567" status: 404 len: 154 microversion: 2.1 time: 0.094817 Jul 21 10:52:35.911359 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 400/789] 10.222.0.48 () {58 vars in 1415 bytes} [Thu Jul 21 10:52:35 2022] DELETE /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4/os-volume_attachments/eae9be38-e38e-4e52-accb-d0ba35b74567 => generated 154 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 10:52:35.971143 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-6972260c-33e2-4a25-b138-addec7232801 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:52:35.971753 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-6972260c-33e2-4a25-b138-addec7232801 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 1457b868-0630-42f6-958c-da6d5bbab2ce] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:52:35.978357 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6972260c-33e2-4a25-b138-addec7232801 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:35.978904 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6972260c-33e2-4a25-b138-addec7232801 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:35.979662 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6972260c-33e2-4a25-b138-addec7232801 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:35.980100 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6972260c-33e2-4a25-b138-addec7232801 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:36.115172 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-6972260c-33e2-4a25-b138-addec7232801 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906e4bc4e9cc45ecb01cfca7918e461d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc215aadb5345d791945658832aae4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:52:36.120321 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-6972260c-33e2-4a25-b138-addec7232801 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/1457b868-0630-42f6-958c-da6d5bbab2ce" status: 200 len: 1367 microversion: 2.1 time: 0.152988 Jul 21 10:52:36.120972 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 390/790] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:52:35 2022] GET /compute/v2.1/servers/1457b868-0630-42f6-958c-da6d5bbab2ce => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:52:37.138387 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-0a628da8-28a4-4ad3-9261-848f768d0ba8 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:52:37.139758 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-0a628da8-28a4-4ad3-9261-848f768d0ba8 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 1457b868-0630-42f6-958c-da6d5bbab2ce] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:52:37.146183 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0a628da8-28a4-4ad3-9261-848f768d0ba8 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:37.146660 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0a628da8-28a4-4ad3-9261-848f768d0ba8 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:37.147428 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0a628da8-28a4-4ad3-9261-848f768d0ba8 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:37.147854 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0a628da8-28a4-4ad3-9261-848f768d0ba8 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:37.185236 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-4881e1bc-9fdb-4da8-ba8e-6df9dc425437 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:52:37.186457 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-4881e1bc-9fdb-4da8-ba8e-6df9dc425437 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] [instance: 6597f555-38e1-4d14-bf7c-6d8b5e5a26d4] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:52:37.193380 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4881e1bc-9fdb-4da8-ba8e-6df9dc425437 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:37.194058 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4881e1bc-9fdb-4da8-ba8e-6df9dc425437 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:37.194640 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4881e1bc-9fdb-4da8-ba8e-6df9dc425437 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:37.195076 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4881e1bc-9fdb-4da8-ba8e-6df9dc425437 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:37.225445 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-4881e1bc-9fdb-4da8-ba8e-6df9dc425437 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] [instance: 6597f555-38e1-4d14-bf7c-6d8b5e5a26d4] Going to try to terminate instance {{(pid=124868) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 10:52:37.286364 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-0a628da8-28a4-4ad3-9261-848f768d0ba8 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906e4bc4e9cc45ecb01cfca7918e461d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc215aadb5345d791945658832aae4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:52:37.294287 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-0a628da8-28a4-4ad3-9261-848f768d0ba8 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/1457b868-0630-42f6-958c-da6d5bbab2ce" status: 200 len: 1557 microversion: 2.1 time: 0.159873 Jul 21 10:52:37.294889 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 401/791] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:52:37 2022] GET /compute/v2.1/servers/1457b868-0630-42f6-958c-da6d5bbab2ce => generated 1557 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:52:37.311403 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-ed642039-d369-462f-89d1-84604ad091f3 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:52:37.311890 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-ed642039-d369-462f-89d1-84604ad091f3 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 1457b868-0630-42f6-958c-da6d5bbab2ce] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:52:37.317740 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ed642039-d369-462f-89d1-84604ad091f3 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:37.318189 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ed642039-d369-462f-89d1-84604ad091f3 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:37.318977 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ed642039-d369-462f-89d1-84604ad091f3 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:37.319410 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ed642039-d369-462f-89d1-84604ad091f3 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:37.397238 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-ed642039-d369-462f-89d1-84604ad091f3 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/1457b868-0630-42f6-958c-da6d5bbab2ce/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090322 Jul 21 10:52:37.397833 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 402/792] 10.222.0.48 () {58 vars in 1274 bytes} [Thu Jul 21 10:52:37 2022] GET /compute/v2.1/servers/1457b868-0630-42f6-958c-da6d5bbab2ce/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 10:52:37.486291 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-4881e1bc-9fdb-4da8-ba8e-6df9dc425437 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] 10.222.0.48 "DELETE /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4" status: 204 len: 0 microversion: 2.1 time: 0.304444 Jul 21 10:52:37.486928 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 391/793] 10.222.0.48 () {58 vars in 1238 bytes} [Thu Jul 21 10:52:37 2022] DELETE /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 10:52:37.495388 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-b53b413d-bd67-4a8f-89ed-a4e8f9c2355f tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:52:37.496409 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-b53b413d-bd67-4a8f-89ed-a4e8f9c2355f tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] [instance: 6597f555-38e1-4d14-bf7c-6d8b5e5a26d4] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:52:37.502784 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b53b413d-bd67-4a8f-89ed-a4e8f9c2355f tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:37.503234 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b53b413d-bd67-4a8f-89ed-a4e8f9c2355f tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:37.504000 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b53b413d-bd67-4a8f-89ed-a4e8f9c2355f tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:37.504434 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b53b413d-bd67-4a8f-89ed-a4e8f9c2355f tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:37.737624 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-b53b413d-bd67-4a8f-89ed-a4e8f9c2355f tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0271efe4b4e9592b29d9f124519b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eff05785bd84522ad637d8bed14563d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:52:37.745032 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-b53b413d-bd67-4a8f-89ed-a4e8f9c2355f tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] 10.222.0.48 "GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4" status: 200 len: 1553 microversion: 2.1 time: 0.253714 Jul 21 10:52:37.745594 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 403/794] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:52:37 2022] GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4 => generated 1553 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:52:37.939590 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-3568ed33-64f6-4bad-8e67-5325a06e34d2 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:52:37.940165 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-3568ed33-64f6-4bad-8e67-5325a06e34d2 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 68c9ec60-9f75-4491-a780-6c339cc6d445] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:52:37.946470 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3568ed33-64f6-4bad-8e67-5325a06e34d2 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:37.946954 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3568ed33-64f6-4bad-8e67-5325a06e34d2 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:37.947785 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3568ed33-64f6-4bad-8e67-5325a06e34d2 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:37.948220 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3568ed33-64f6-4bad-8e67-5325a06e34d2 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:37.972048 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-3568ed33-64f6-4bad-8e67-5325a06e34d2 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445/ips" status: 200 len: 151 microversion: 2.20 time: 0.037381 Jul 21 10:52:37.972641 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 392/795] 10.222.0.48 () {60 vars in 1288 bytes} [Thu Jul 21 10:52:37 2022] GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445/ips => generated 151 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 10:52:38.471761 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [req-e99e3239-dc1c-411c-991e-d21c63981ddc req-9c4fd141-906f-4d6b-80e9-babd4730403a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1457b868-0630-42f6-958c-da6d5bbab2ce", "tag": "5e6868c7-2e19-4c0b-b436-ff20ce312453"}]} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:52:38.480657 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-e99e3239-dc1c-411c-991e-d21c63981ddc req-9c4fd141-906f-4d6b-80e9-babd4730403a service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:38.481429 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-e99e3239-dc1c-411c-991e-d21c63981ddc req-9c4fd141-906f-4d6b-80e9-babd4730403a service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:38.495949 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.compute.server_external_events [req-e99e3239-dc1c-411c-991e-d21c63981ddc req-9c4fd141-906f-4d6b-80e9-babd4730403a service nova] Creating event network-changed:5e6868c7-2e19-4c0b-b436-ff20ce312453 for instance 1457b868-0630-42f6-958c-da6d5bbab2ce on hv-cinder-84980 Jul 21 10:52:38.499135 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [req-e99e3239-dc1c-411c-991e-d21c63981ddc req-9c4fd141-906f-4d6b-80e9-babd4730403a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032168 Jul 21 10:52:38.499741 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 404/796] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 21 10:52:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:52:38.762396 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-6942554b-be58-45aa-ac90-4ac42116bc0c tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:52:38.763020 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-6942554b-be58-45aa-ac90-4ac42116bc0c tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] [instance: 6597f555-38e1-4d14-bf7c-6d8b5e5a26d4] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:52:38.770953 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6942554b-be58-45aa-ac90-4ac42116bc0c tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:38.771402 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6942554b-be58-45aa-ac90-4ac42116bc0c tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:38.772163 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6942554b-be58-45aa-ac90-4ac42116bc0c tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:38.772594 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6942554b-be58-45aa-ac90-4ac42116bc0c tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:38.908970 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-6942554b-be58-45aa-ac90-4ac42116bc0c tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0271efe4b4e9592b29d9f124519b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eff05785bd84522ad637d8bed14563d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:52:38.916458 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-6942554b-be58-45aa-ac90-4ac42116bc0c tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] 10.222.0.48 "GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4" status: 200 len: 1553 microversion: 2.1 time: 0.157990 Jul 21 10:52:38.917362 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 393/797] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:52:38 2022] GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4 => generated 1553 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:52:39.934133 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-0238cd84-e04e-475e-834d-49ce436c9c37 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:52:39.934860 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-0238cd84-e04e-475e-834d-49ce436c9c37 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] [instance: 6597f555-38e1-4d14-bf7c-6d8b5e5a26d4] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:52:39.941844 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0238cd84-e04e-475e-834d-49ce436c9c37 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:39.942294 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0238cd84-e04e-475e-834d-49ce436c9c37 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:39.943085 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0238cd84-e04e-475e-834d-49ce436c9c37 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:39.943519 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0238cd84-e04e-475e-834d-49ce436c9c37 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:40.075233 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-0238cd84-e04e-475e-834d-49ce436c9c37 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0271efe4b4e9592b29d9f124519b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eff05785bd84522ad637d8bed14563d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:52:40.083594 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-0238cd84-e04e-475e-834d-49ce436c9c37 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] 10.222.0.48 "GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4" status: 200 len: 1553 microversion: 2.1 time: 0.153738 Jul 21 10:52:40.084185 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 405/798] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:52:39 2022] GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4 => generated 1553 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:52:41.100850 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-3b9233a1-20e6-4b95-a167-74059fab1a0e tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:52:41.101618 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-3b9233a1-20e6-4b95-a167-74059fab1a0e tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] [instance: 6597f555-38e1-4d14-bf7c-6d8b5e5a26d4] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:52:41.109268 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3b9233a1-20e6-4b95-a167-74059fab1a0e tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:41.109714 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3b9233a1-20e6-4b95-a167-74059fab1a0e tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:41.110470 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3b9233a1-20e6-4b95-a167-74059fab1a0e tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:41.110922 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3b9233a1-20e6-4b95-a167-74059fab1a0e tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:41.247761 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-3b9233a1-20e6-4b95-a167-74059fab1a0e tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0271efe4b4e9592b29d9f124519b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eff05785bd84522ad637d8bed14563d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:52:41.256010 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-3b9233a1-20e6-4b95-a167-74059fab1a0e tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] 10.222.0.48 "GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4" status: 200 len: 1553 microversion: 2.1 time: 0.158954 Jul 21 10:52:41.256589 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 394/799] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:52:41 2022] GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4 => generated 1553 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:52:41.764985 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [req-7a165d4c-e608-48b5-98f7-6f9362a0b721 req-b8fba4c0-6c64-4bff-ba4d-a061b8326d3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6597f555-38e1-4d14-bf7c-6d8b5e5a26d4", "name": "network-vif-deleted", "tag": "24113ecd-45f8-473c-a1aa-fc93cff6c402"}]} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:52:41.774035 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-7a165d4c-e608-48b5-98f7-6f9362a0b721 req-b8fba4c0-6c64-4bff-ba4d-a061b8326d3a service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:41.774807 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-7a165d4c-e608-48b5-98f7-6f9362a0b721 req-b8fba4c0-6c64-4bff-ba4d-a061b8326d3a service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:41.787059 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.compute.server_external_events [req-7a165d4c-e608-48b5-98f7-6f9362a0b721 req-b8fba4c0-6c64-4bff-ba4d-a061b8326d3a service nova] Creating event network-vif-deleted:24113ecd-45f8-473c-a1aa-fc93cff6c402 for instance 6597f555-38e1-4d14-bf7c-6d8b5e5a26d4 on hv-cinder-84980 Jul 21 10:52:41.792260 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [req-7a165d4c-e608-48b5-98f7-6f9362a0b721 req-b8fba4c0-6c64-4bff-ba4d-a061b8326d3a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030920 Jul 21 10:52:41.792860 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 406/800] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 21 10:52:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:52:42.158451 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-199894f6-a613-4c98-a358-6248f2e6a85a tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:52:42.168378 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-199894f6-a613-4c98-a358-6248f2e6a85a tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 68c9ec60-9f75-4491-a780-6c339cc6d445] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:52:42.179046 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-199894f6-a613-4c98-a358-6248f2e6a85a tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:42.179943 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-199894f6-a613-4c98-a358-6248f2e6a85a tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:42.181634 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-199894f6-a613-4c98-a358-6248f2e6a85a tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:42.182430 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-199894f6-a613-4c98-a358-6248f2e6a85a tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:42.228397 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.objects.instance [None req-199894f6-a613-4c98-a358-6248f2e6a85a tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lazy-loading 'flavor' on Instance uuid 68c9ec60-9f75-4491-a780-6c339cc6d445 {{(pid=124868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 10:52:42.273754 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-e32c14a6-d0ce-40db-9baf-c0dad6ab5eeb tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:52:42.274367 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-e32c14a6-d0ce-40db-9baf-c0dad6ab5eeb tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] [instance: 6597f555-38e1-4d14-bf7c-6d8b5e5a26d4] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:52:42.281207 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e32c14a6-d0ce-40db-9baf-c0dad6ab5eeb tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:42.281657 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e32c14a6-d0ce-40db-9baf-c0dad6ab5eeb tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:42.282421 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e32c14a6-d0ce-40db-9baf-c0dad6ab5eeb tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:42.282895 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e32c14a6-d0ce-40db-9baf-c0dad6ab5eeb tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:42.315419 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e32c14a6-d0ce-40db-9baf-c0dad6ab5eeb tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:42.315788 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e32c14a6-d0ce-40db-9baf-c0dad6ab5eeb tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:42.316241 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.objects.instance [None req-e32c14a6-d0ce-40db-9baf-c0dad6ab5eeb tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lazy-loading 'fault' on Instance uuid 6597f555-38e1-4d14-bf7c-6d8b5e5a26d4 {{(pid=124867) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 10:52:42.367536 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-e32c14a6-d0ce-40db-9baf-c0dad6ab5eeb tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae0271efe4b4e9592b29d9f124519b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eff05785bd84522ad637d8bed14563d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:52:42.375218 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-e32c14a6-d0ce-40db-9baf-c0dad6ab5eeb tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] 10.222.0.48 "GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4" status: 200 len: 1348 microversion: 2.1 time: 0.105745 Jul 21 10:52:42.375884 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 407/801] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:52:42 2022] GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4 => generated 1348 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:52:42.803176 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-199894f6-a613-4c98-a358-6248f2e6a85a tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "POST /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445/action" status: 202 len: 0 microversion: 2.20 time: 0.654261 Jul 21 10:52:42.804677 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 395/802] 10.222.0.48 () {62 vars in 1318 bytes} [Thu Jul 21 10:52:42 2022] POST /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445/action => generated 0 bytes in 657 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 21 10:52:42.813979 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-d682a15d-52b6-46e0-8fff-66ca026769ef tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:52:42.814608 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-d682a15d-52b6-46e0-8fff-66ca026769ef tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 68c9ec60-9f75-4491-a780-6c339cc6d445] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:52:42.822820 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d682a15d-52b6-46e0-8fff-66ca026769ef tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:42.823267 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d682a15d-52b6-46e0-8fff-66ca026769ef tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:42.824027 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d682a15d-52b6-46e0-8fff-66ca026769ef tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:42.824460 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d682a15d-52b6-46e0-8fff-66ca026769ef tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:42.958349 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-d682a15d-52b6-46e0-8fff-66ca026769ef tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:52:42.966835 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-d682a15d-52b6-46e0-8fff-66ca026769ef tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:52:42.968401 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-d682a15d-52b6-46e0-8fff-66ca026769ef tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:52:42.969559 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-d682a15d-52b6-46e0-8fff-66ca026769ef tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445" status: 200 len: 1722 microversion: 2.20 time: 0.160706 Jul 21 10:52:42.970155 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 408/803] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:52:42 2022] GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:52:43.395817 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-f1182369-fe03-4dbc-9db7-62466c31ebd9 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:52:43.396501 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-f1182369-fe03-4dbc-9db7-62466c31ebd9 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] [instance: 6597f555-38e1-4d14-bf7c-6d8b5e5a26d4] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:52:43.402662 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f1182369-fe03-4dbc-9db7-62466c31ebd9 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:43.403102 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f1182369-fe03-4dbc-9db7-62466c31ebd9 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:43.403848 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f1182369-fe03-4dbc-9db7-62466c31ebd9 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:43.405067 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f1182369-fe03-4dbc-9db7-62466c31ebd9 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:43.418918 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.wsgi [None req-f1182369-fe03-4dbc-9db7-62466c31ebd9 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] HTTP exception thrown: Instance 6597f555-38e1-4d14-bf7c-6d8b5e5a26d4 could not be found. Jul 21 10:52:43.421238 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-f1182369-fe03-4dbc-9db7-62466c31ebd9 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Request method failure captured: Jul 21 10:52:43.421238 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: request: GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4 HTTP/1.1 Jul 21 10:52:43.421238 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Accept: application/json Jul 21 10:52:43.421238 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Accept-Encoding: identity Jul 21 10:52:43.421238 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Connection: close Jul 21 10:52:43.421238 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Content-Length: 0 Jul 21 10:52:43.421238 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Content-Type: application/json Jul 21 10:52:43.421238 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Host: 10.222.0.48 Jul 21 10:52:43.421238 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Openstack-System-Scope: None Jul 21 10:52:43.421238 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: User-Agent: python-urllib3/1.26.9 Jul 21 10:52:43.421238 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Auth-Token: gAAAAABi2S85SN4vx5Y5i_GT0TBc0w4J_cTYA85eiudq3RsShsf6cZmVF_DbYTR7ICDEvnXujyRqZJ-nwC3usk9fNcEwpPCYEZddQgRlF8AERckDd1P3xN5cEPXGkx3y5_wG6ZTImVBMmKft2Lj5BrO-T-PFQ8LkAIvJqM9sBjWeidGzMs6JeQY Jul 21 10:52:43.421238 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Domain-Id: None Jul 21 10:52:43.421238 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Domain-Name: None Jul 21 10:52:43.421238 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Identity-Status: Confirmed Jul 21 10:52:43.421238 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Is-Admin-Project: True Jul 21 10:52:43.421238 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Domain-Id: default Jul 21 10:52:43.421238 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Domain-Name: Default Jul 21 10:52:43.421238 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Id: 2eff05785bd84522ad637d8bed14563d Jul 21 10:52:43.421238 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Name: tempest-TestMinimumBasicScenario-1018116383 Jul 21 10:52:43.421238 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Role: reader,member Jul 21 10:52:43.421238 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Roles: reader,member Jul 21 10:52:43.422811 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2eff05785bd84522ad637d8bed14563d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2eff05785bd84522ad637d8bed14563d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2eff05785bd84522ad637d8bed14563d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2eff05785bd84522ad637d8bed14563d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] Jul 21 10:52:43.422811 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Tenant: tempest-TestMinimumBasicScenario-1018116383 Jul 21 10:52:43.422811 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Tenant-Id: 2eff05785bd84522ad637d8bed14563d Jul 21 10:52:43.422811 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1018116383 Jul 21 10:52:43.422811 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User: tempest-TestMinimumBasicScenario-1018116383-project Jul 21 10:52:43.422811 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Domain-Id: default Jul 21 10:52:43.422811 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Domain-Name: Default Jul 21 10:52:43.422811 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Id: 4ae0271efe4b4e9592b29d9f124519b7 Jul 21 10:52:43.422811 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Name: tempest-TestMinimumBasicScenario-1018116383-project Jul 21 10:52:43.422811 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: method: > Jul 21 10:52:43.422811 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: exception: Instance 6597f555-38e1-4d14-bf7c-6d8b5e5a26d4 could not be found. Jul 21 10:52:43.422811 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: action_args: {'id': '6597f555-38e1-4d14-bf7c-6d8b5e5a26d4'} Jul 21 10:52:43.423829 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 10:52:43.423829 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:52:43.423829 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 10:52:43.423829 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 10:52:43.423829 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 10:52:43.423829 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 10:52:43.423829 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 10:52:43.423829 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 10:52:43.423829 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 10:52:43.423829 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 10:52:43.423829 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6597f555-38e1-4d14-bf7c-6d8b5e5a26d4 could not be found. Jul 21 10:52:43.423829 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:52:43.423829 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:52:43.423829 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:52:43.423829 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:52:43.423829 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:52:43.423829 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:52:43.423829 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 10:52:43.423829 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 10:52:43.423829 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 10:52:43.425284 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 10:52:43.425284 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 10:52:43.425284 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 10:52:43.425284 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 10:52:43.425284 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 10:52:43.425284 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 10:52:43.425284 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 10:52:43.425284 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6597f555-38e1-4d14-bf7c-6d8b5e5a26d4 could not be found. Jul 21 10:52:43.425284 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:52:43.425284 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:52:43.425284 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:52:43.425284 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:52:43.425284 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:52:43.425284 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:52:43.425284 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 10:52:43.425284 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 10:52:43.425284 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6597f555-38e1-4d14-bf7c-6d8b5e5a26d4 could not be found. Jul 21 10:52:43.425284 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:52:43.426913 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-f1182369-fe03-4dbc-9db7-62466c31ebd9 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Returning 404 to user: Instance 6597f555-38e1-4d14-bf7c-6d8b5e5a26d4 could not be found. {{(pid=124868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 10:52:43.426913 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-f1182369-fe03-4dbc-9db7-62466c31ebd9 tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] 10.222.0.48 "GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4" status: 404 len: 111 microversion: 2.1 time: 0.031736 Jul 21 10:52:43.426913 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 396/804] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:52:43 2022] GET /compute/v2.1/servers/6597f555-38e1-4d14-bf7c-6d8b5e5a26d4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 10:52:43.431591 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-278196b1-db0d-45cf-b95a-4a282b91609d tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] Calling method '.version_select at 0x7f795ea7b9d0>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:52:43.509072 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-278196b1-db0d-45cf-b95a-4a282b91609d tempest-TestMinimumBasicScenario-1018116383 tempest-TestMinimumBasicScenario-1018116383-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-925942524" status: 202 len: 0 microversion: 2.1 time: 0.081194 Jul 21 10:52:43.509644 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 409/805] 10.222.0.48 () {58 vars in 1268 bytes} [Thu Jul 21 10:52:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-925942524 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 10:52:43.988836 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-b5bee963-47eb-49e8-84cf-7b9256da6d2b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:52:43.989658 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-b5bee963-47eb-49e8-84cf-7b9256da6d2b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 68c9ec60-9f75-4491-a780-6c339cc6d445] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:52:43.995848 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b5bee963-47eb-49e8-84cf-7b9256da6d2b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:43.996233 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b5bee963-47eb-49e8-84cf-7b9256da6d2b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:43.996987 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b5bee963-47eb-49e8-84cf-7b9256da6d2b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:43.997418 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b5bee963-47eb-49e8-84cf-7b9256da6d2b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:44.137471 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-b5bee963-47eb-49e8-84cf-7b9256da6d2b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:52:44.146981 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-b5bee963-47eb-49e8-84cf-7b9256da6d2b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:52:44.148458 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-b5bee963-47eb-49e8-84cf-7b9256da6d2b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:52:44.149590 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-b5bee963-47eb-49e8-84cf-7b9256da6d2b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445" status: 200 len: 1722 microversion: 2.20 time: 0.165046 Jul 21 10:52:44.150136 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 397/806] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:52:43 2022] GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:52:45.170384 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-993718c0-2aa3-46da-8203-1964654ced6c tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:52:45.171523 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-993718c0-2aa3-46da-8203-1964654ced6c tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 68c9ec60-9f75-4491-a780-6c339cc6d445] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:52:45.177909 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-993718c0-2aa3-46da-8203-1964654ced6c tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:45.181920 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-993718c0-2aa3-46da-8203-1964654ced6c tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:45.181920 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-993718c0-2aa3-46da-8203-1964654ced6c tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:45.181920 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-993718c0-2aa3-46da-8203-1964654ced6c tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:45.647166 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-993718c0-2aa3-46da-8203-1964654ced6c tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:52:45.648448 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-993718c0-2aa3-46da-8203-1964654ced6c tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:52:45.650668 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-993718c0-2aa3-46da-8203-1964654ced6c tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:52:45.651905 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-993718c0-2aa3-46da-8203-1964654ced6c tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445" status: 200 len: 1722 microversion: 2.20 time: 0.487621 Jul 21 10:52:45.652765 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 410/807] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:52:45 2022] GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445 => generated 1722 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:52:46.670531 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-cb9a4ec0-75d2-4ae5-b47e-b763d119efba tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:52:46.671194 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-cb9a4ec0-75d2-4ae5-b47e-b763d119efba tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 68c9ec60-9f75-4491-a780-6c339cc6d445] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:52:46.678293 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-cb9a4ec0-75d2-4ae5-b47e-b763d119efba tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:46.678778 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-cb9a4ec0-75d2-4ae5-b47e-b763d119efba tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:46.679556 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-cb9a4ec0-75d2-4ae5-b47e-b763d119efba tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:46.680052 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-cb9a4ec0-75d2-4ae5-b47e-b763d119efba tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:46.892830 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-cb9a4ec0-75d2-4ae5-b47e-b763d119efba tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:52:46.901400 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-cb9a4ec0-75d2-4ae5-b47e-b763d119efba tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:52:46.902946 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-cb9a4ec0-75d2-4ae5-b47e-b763d119efba tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:52:46.904772 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-cb9a4ec0-75d2-4ae5-b47e-b763d119efba tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445" status: 200 len: 1722 microversion: 2.20 time: 0.237597 Jul 21 10:52:46.905328 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 398/808] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:52:46 2022] GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445 => generated 1722 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 10:52:47.923537 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-a200a0ab-3cbe-412d-bab7-ace97fd1d4a4 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:52:47.924086 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-a200a0ab-3cbe-412d-bab7-ace97fd1d4a4 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 68c9ec60-9f75-4491-a780-6c339cc6d445] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:52:47.930661 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a200a0ab-3cbe-412d-bab7-ace97fd1d4a4 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:47.931116 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a200a0ab-3cbe-412d-bab7-ace97fd1d4a4 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:47.931881 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a200a0ab-3cbe-412d-bab7-ace97fd1d4a4 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:47.932314 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a200a0ab-3cbe-412d-bab7-ace97fd1d4a4 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:48.083832 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-a200a0ab-3cbe-412d-bab7-ace97fd1d4a4 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:52:48.094175 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-a200a0ab-3cbe-412d-bab7-ace97fd1d4a4 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:52:48.096041 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-a200a0ab-3cbe-412d-bab7-ace97fd1d4a4 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:52:48.097976 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-a200a0ab-3cbe-412d-bab7-ace97fd1d4a4 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445" status: 200 len: 1722 microversion: 2.20 time: 0.179076 Jul 21 10:52:48.099254 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 411/809] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:52:47 2022] GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445 => generated 1722 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:52:49.117217 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-c8c6705a-5b8e-45d8-9453-8fd582027fdd tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:52:49.118275 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-c8c6705a-5b8e-45d8-9453-8fd582027fdd tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 68c9ec60-9f75-4491-a780-6c339cc6d445] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:52:49.124473 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c8c6705a-5b8e-45d8-9453-8fd582027fdd tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:49.128421 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c8c6705a-5b8e-45d8-9453-8fd582027fdd tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:49.128421 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c8c6705a-5b8e-45d8-9453-8fd582027fdd tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:49.128421 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c8c6705a-5b8e-45d8-9453-8fd582027fdd tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:49.353754 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-c8c6705a-5b8e-45d8-9453-8fd582027fdd tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:52:49.362356 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-c8c6705a-5b8e-45d8-9453-8fd582027fdd tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:52:49.363930 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-c8c6705a-5b8e-45d8-9453-8fd582027fdd tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:52:49.366893 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-c8c6705a-5b8e-45d8-9453-8fd582027fdd tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445" status: 200 len: 1722 microversion: 2.20 time: 0.252369 Jul 21 10:52:49.366893 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 399/810] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:52:49 2022] GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445 => generated 1722 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:52:50.383746 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-6ab6c4e6-9341-48b7-b721-3fa9441330c1 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:52:50.384586 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-6ab6c4e6-9341-48b7-b721-3fa9441330c1 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 68c9ec60-9f75-4491-a780-6c339cc6d445] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:52:50.392534 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6ab6c4e6-9341-48b7-b721-3fa9441330c1 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:50.393061 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6ab6c4e6-9341-48b7-b721-3fa9441330c1 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:50.393898 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6ab6c4e6-9341-48b7-b721-3fa9441330c1 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:50.394419 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6ab6c4e6-9341-48b7-b721-3fa9441330c1 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:50.865572 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-6ab6c4e6-9341-48b7-b721-3fa9441330c1 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:52:50.874722 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-6ab6c4e6-9341-48b7-b721-3fa9441330c1 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:52:50.876236 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-6ab6c4e6-9341-48b7-b721-3fa9441330c1 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:52:50.877378 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-6ab6c4e6-9341-48b7-b721-3fa9441330c1 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445" status: 200 len: 1722 microversion: 2.20 time: 0.497480 Jul 21 10:52:50.890576 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 412/811] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:52:50 2022] GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445 => generated 1722 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:52:51.899642 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-ac00b1cd-0c52-43ab-a226-0891c739ac1e tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:52:51.900179 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-ac00b1cd-0c52-43ab-a226-0891c739ac1e tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 68c9ec60-9f75-4491-a780-6c339cc6d445] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:52:51.907461 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ac00b1cd-0c52-43ab-a226-0891c739ac1e tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:51.907910 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ac00b1cd-0c52-43ab-a226-0891c739ac1e tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:51.908666 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ac00b1cd-0c52-43ab-a226-0891c739ac1e tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:51.909101 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ac00b1cd-0c52-43ab-a226-0891c739ac1e tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:52.049566 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-ac00b1cd-0c52-43ab-a226-0891c739ac1e tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:52:52.058393 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-ac00b1cd-0c52-43ab-a226-0891c739ac1e tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:52:52.059975 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-ac00b1cd-0c52-43ab-a226-0891c739ac1e tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:52:52.061138 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-ac00b1cd-0c52-43ab-a226-0891c739ac1e tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445" status: 200 len: 1722 microversion: 2.20 time: 0.165500 Jul 21 10:52:52.061686 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 400/812] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:52:51 2022] GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:52:53.079085 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-d6765700-f1d8-462c-84d2-bccc0ae1812b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:52:53.079760 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-d6765700-f1d8-462c-84d2-bccc0ae1812b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 68c9ec60-9f75-4491-a780-6c339cc6d445] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:52:53.088463 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d6765700-f1d8-462c-84d2-bccc0ae1812b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:53.088463 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d6765700-f1d8-462c-84d2-bccc0ae1812b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:53.088463 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d6765700-f1d8-462c-84d2-bccc0ae1812b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:53.088463 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d6765700-f1d8-462c-84d2-bccc0ae1812b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:53.236269 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-d6765700-f1d8-462c-84d2-bccc0ae1812b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:52:53.248278 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-d6765700-f1d8-462c-84d2-bccc0ae1812b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:52:53.250030 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-d6765700-f1d8-462c-84d2-bccc0ae1812b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:52:53.251197 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-d6765700-f1d8-462c-84d2-bccc0ae1812b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445" status: 200 len: 1722 microversion: 2.20 time: 0.176075 Jul 21 10:52:53.251751 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 413/813] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:52:53 2022] GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445 => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:52:54.269374 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-5d317f8c-a8fa-4643-af9a-6ce5a19cdf07 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:52:54.269904 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-5d317f8c-a8fa-4643-af9a-6ce5a19cdf07 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 68c9ec60-9f75-4491-a780-6c339cc6d445] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:52:54.272430 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_api:SELECT=67,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:52:54.277272 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5d317f8c-a8fa-4643-af9a-6ce5a19cdf07 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:54.277721 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5d317f8c-a8fa-4643-af9a-6ce5a19cdf07 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:54.278488 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5d317f8c-a8fa-4643-af9a-6ce5a19cdf07 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:54.278958 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5d317f8c-a8fa-4643-af9a-6ce5a19cdf07 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:54.412199 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-5d317f8c-a8fa-4643-af9a-6ce5a19cdf07 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:52:54.421986 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-5d317f8c-a8fa-4643-af9a-6ce5a19cdf07 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:52:54.423630 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-5d317f8c-a8fa-4643-af9a-6ce5a19cdf07 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:52:54.424883 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-5d317f8c-a8fa-4643-af9a-6ce5a19cdf07 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445" status: 200 len: 1743 microversion: 2.20 time: 0.159514 Jul 21 10:52:54.425509 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 401/814] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:52:54 2022] GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445 => generated 1743 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:52:55.443933 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-a7df62fa-26b9-4483-bd5f-181707afe0cf tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:52:55.444565 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-a7df62fa-26b9-4483-bd5f-181707afe0cf tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 68c9ec60-9f75-4491-a780-6c339cc6d445] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:52:55.451663 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a7df62fa-26b9-4483-bd5f-181707afe0cf tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:55.452111 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a7df62fa-26b9-4483-bd5f-181707afe0cf tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:55.452883 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a7df62fa-26b9-4483-bd5f-181707afe0cf tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:55.453317 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a7df62fa-26b9-4483-bd5f-181707afe0cf tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:55.589315 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-a7df62fa-26b9-4483-bd5f-181707afe0cf tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:52:55.598005 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-a7df62fa-26b9-4483-bd5f-181707afe0cf tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:52:55.599522 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-a7df62fa-26b9-4483-bd5f-181707afe0cf tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:52:55.600653 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-a7df62fa-26b9-4483-bd5f-181707afe0cf tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445" status: 200 len: 1743 microversion: 2.20 time: 0.160681 Jul 21 10:52:55.601212 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 414/815] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:52:55 2022] GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445 => generated 1743 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:52:56.619330 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-dd776549-b175-4b66-a5aa-b06305be07d3 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:52:56.620542 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-dd776549-b175-4b66-a5aa-b06305be07d3 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 68c9ec60-9f75-4491-a780-6c339cc6d445] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:52:56.629210 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-dd776549-b175-4b66-a5aa-b06305be07d3 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:56.629846 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-dd776549-b175-4b66-a5aa-b06305be07d3 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:56.630856 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-dd776549-b175-4b66-a5aa-b06305be07d3 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:56.631440 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-dd776549-b175-4b66-a5aa-b06305be07d3 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:56.650243 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:52:56.808227 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-dd776549-b175-4b66-a5aa-b06305be07d3 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:52:56.818897 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-dd776549-b175-4b66-a5aa-b06305be07d3 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:52:56.820617 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-dd776549-b175-4b66-a5aa-b06305be07d3 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:52:56.821943 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-dd776549-b175-4b66-a5aa-b06305be07d3 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445" status: 200 len: 1738 microversion: 2.20 time: 0.206522 Jul 21 10:52:56.823079 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 402/816] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:52:56 2022] GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445 => generated 1738 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:52:57.833208 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-8bbf154b-01c0-4232-8358-02342c18f972 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:52:57.834343 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-8bbf154b-01c0-4232-8358-02342c18f972 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] [instance: eb24f843-eeb3-43dd-bd48-3bcf68e344cd] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:52:57.843110 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-b03ed06f-c4e0-45e4-9858-3eac8fafb1a4 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:52:57.843656 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8bbf154b-01c0-4232-8358-02342c18f972 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:57.843763 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-b03ed06f-c4e0-45e4-9858-3eac8fafb1a4 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 68c9ec60-9f75-4491-a780-6c339cc6d445] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:52:57.844015 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8bbf154b-01c0-4232-8358-02342c18f972 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:57.844984 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8bbf154b-01c0-4232-8358-02342c18f972 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:57.845590 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8bbf154b-01c0-4232-8358-02342c18f972 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:57.852704 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b03ed06f-c4e0-45e4-9858-3eac8fafb1a4 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:57.853357 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b03ed06f-c4e0-45e4-9858-3eac8fafb1a4 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:57.854297 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b03ed06f-c4e0-45e4-9858-3eac8fafb1a4 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:57.855094 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b03ed06f-c4e0-45e4-9858-3eac8fafb1a4 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:57.871681 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.objects.instance [None req-8bbf154b-01c0-4232-8358-02342c18f972 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lazy-loading 'flavor' on Instance uuid eb24f843-eeb3-43dd-bd48-3bcf68e344cd {{(pid=124867) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 10:52:57.893910 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell1:SELECT=100 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:52:58.024292 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-b03ed06f-c4e0-45e4-9858-3eac8fafb1a4 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:52:58.035067 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-b03ed06f-c4e0-45e4-9858-3eac8fafb1a4 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:52:58.036832 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-b03ed06f-c4e0-45e4-9858-3eac8fafb1a4 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:52:58.038213 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-b03ed06f-c4e0-45e4-9858-3eac8fafb1a4 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445" status: 200 len: 1738 microversion: 2.20 time: 0.199977 Jul 21 10:52:58.038972 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 403/817] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:52:57 2022] GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445 => generated 1738 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 10:52:58.223935 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-8bbf154b-01c0-4232-8358-02342c18f972 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] 10.222.0.48 "POST /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd/action" status: 202 len: 0 microversion: 2.1 time: 0.394708 Jul 21 10:52:58.228059 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 415/818] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 21 10:52:57 2022] POST /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd/action => generated 0 bytes in 396 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 10:52:58.234668 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-3d9bd5aa-a2ae-46c6-9bf1-076f6e8e6300 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:52:58.235284 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-3d9bd5aa-a2ae-46c6-9bf1-076f6e8e6300 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] [instance: eb24f843-eeb3-43dd-bd48-3bcf68e344cd] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:52:58.241980 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3d9bd5aa-a2ae-46c6-9bf1-076f6e8e6300 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:58.242166 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3d9bd5aa-a2ae-46c6-9bf1-076f6e8e6300 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:58.242911 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3d9bd5aa-a2ae-46c6-9bf1-076f6e8e6300 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:58.243327 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3d9bd5aa-a2ae-46c6-9bf1-076f6e8e6300 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:58.403810 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-3d9bd5aa-a2ae-46c6-9bf1-076f6e8e6300 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e3fd195fd14b009ba56950dc542cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620ea9c4eaa74dc5858cf93d9fcad9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:52:58.414800 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-3d9bd5aa-a2ae-46c6-9bf1-076f6e8e6300 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] 10.222.0.48 "GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd" status: 200 len: 1570 microversion: 2.1 time: 0.184505 Jul 21 10:52:58.428644 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 404/819] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:52:58 2022] GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd => generated 1570 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:52:58.619112 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [req-07a1ca68-dba4-4245-81be-66839aa7ca05 req-3635748c-11eb-4226-b81c-2b88df0b5c26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68c9ec60-9f75-4491-a780-6c339cc6d445", "name": "network-vif-plugged", "status": "completed", "tag": "767a932c-587b-4501-b928-eef9dd00de9e"}]} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:52:58.630155 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-07a1ca68-dba4-4245-81be-66839aa7ca05 req-3635748c-11eb-4226-b81c-2b88df0b5c26 service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:58.634293 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-07a1ca68-dba4-4245-81be-66839aa7ca05 req-3635748c-11eb-4226-b81c-2b88df0b5c26 service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:58.645764 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.compute.server_external_events [req-07a1ca68-dba4-4245-81be-66839aa7ca05 req-3635748c-11eb-4226-b81c-2b88df0b5c26 service nova] Creating event network-vif-plugged:767a932c-587b-4501-b928-eef9dd00de9e for instance 68c9ec60-9f75-4491-a780-6c339cc6d445 on hv-cinder-84980 Jul 21 10:52:58.651139 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [req-07a1ca68-dba4-4245-81be-66839aa7ca05 req-3635748c-11eb-4226-b81c-2b88df0b5c26 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038678 Jul 21 10:52:58.652043 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 416/820] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 21 10:52:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:52:59.062483 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-7825360d-4556-4bd1-99d3-e67710a69993 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:52:59.063038 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-7825360d-4556-4bd1-99d3-e67710a69993 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 68c9ec60-9f75-4491-a780-6c339cc6d445] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:52:59.069620 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7825360d-4556-4bd1-99d3-e67710a69993 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:59.070082 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7825360d-4556-4bd1-99d3-e67710a69993 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:59.070844 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7825360d-4556-4bd1-99d3-e67710a69993 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:59.071277 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7825360d-4556-4bd1-99d3-e67710a69993 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:59.278069 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-7825360d-4556-4bd1-99d3-e67710a69993 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:52:59.278069 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-7825360d-4556-4bd1-99d3-e67710a69993 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:52:59.279632 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-7825360d-4556-4bd1-99d3-e67710a69993 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:52:59.279632 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-7825360d-4556-4bd1-99d3-e67710a69993 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445" status: 200 len: 1738 microversion: 2.20 time: 0.173071 Jul 21 10:52:59.279632 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 405/821] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:52:59 2022] GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445 => generated 1738 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 10:52:59.434551 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-349403ad-df12-4c59-a06d-5cd3314070d3 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:52:59.435393 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-349403ad-df12-4c59-a06d-5cd3314070d3 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] [instance: eb24f843-eeb3-43dd-bd48-3bcf68e344cd] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:52:59.442110 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-349403ad-df12-4c59-a06d-5cd3314070d3 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:59.442571 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-349403ad-df12-4c59-a06d-5cd3314070d3 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:59.443322 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-349403ad-df12-4c59-a06d-5cd3314070d3 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:52:59.443798 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-349403ad-df12-4c59-a06d-5cd3314070d3 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:52:59.609955 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-349403ad-df12-4c59-a06d-5cd3314070d3 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e3fd195fd14b009ba56950dc542cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620ea9c4eaa74dc5858cf93d9fcad9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:52:59.617576 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-349403ad-df12-4c59-a06d-5cd3314070d3 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] 10.222.0.48 "GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd" status: 200 len: 1570 microversion: 2.1 time: 0.187734 Jul 21 10:52:59.618442 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 417/822] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:52:59 2022] GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd => generated 1570 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:53:00.249933 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-460e3b13-033a-471c-996f-2eec58fa3917 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:53:00.250555 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-460e3b13-033a-471c-996f-2eec58fa3917 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 68c9ec60-9f75-4491-a780-6c339cc6d445] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:53:00.257106 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-460e3b13-033a-471c-996f-2eec58fa3917 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:00.257829 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-460e3b13-033a-471c-996f-2eec58fa3917 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:00.258825 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-460e3b13-033a-471c-996f-2eec58fa3917 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:00.259422 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-460e3b13-033a-471c-996f-2eec58fa3917 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:00.402481 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-460e3b13-033a-471c-996f-2eec58fa3917 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:00.411617 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-460e3b13-033a-471c-996f-2eec58fa3917 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:00.413145 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-460e3b13-033a-471c-996f-2eec58fa3917 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:00.414302 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-460e3b13-033a-471c-996f-2eec58fa3917 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445" status: 200 len: 1738 microversion: 2.20 time: 0.168374 Jul 21 10:53:00.415949 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 406/823] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:53:00 2022] GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445 => generated 1738 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:53:00.635519 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-288f7c7b-1b22-4f9c-8dbb-fc435c635b6e tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:53:00.636069 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-288f7c7b-1b22-4f9c-8dbb-fc435c635b6e tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] [instance: eb24f843-eeb3-43dd-bd48-3bcf68e344cd] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:53:00.644145 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-288f7c7b-1b22-4f9c-8dbb-fc435c635b6e tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:00.645035 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-288f7c7b-1b22-4f9c-8dbb-fc435c635b6e tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:00.646015 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-288f7c7b-1b22-4f9c-8dbb-fc435c635b6e tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:00.646677 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-288f7c7b-1b22-4f9c-8dbb-fc435c635b6e tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:00.803356 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-288f7c7b-1b22-4f9c-8dbb-fc435c635b6e tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e3fd195fd14b009ba56950dc542cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620ea9c4eaa74dc5858cf93d9fcad9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:00.815603 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-288f7c7b-1b22-4f9c-8dbb-fc435c635b6e tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] 10.222.0.48 "GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd" status: 200 len: 1570 microversion: 2.1 time: 0.183793 Jul 21 10:53:00.825142 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 418/824] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:53:00 2022] GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd => generated 1570 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:53:01.435065 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-8af375ba-20bf-46e5-a1ba-99ec28c49147 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:53:01.436312 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-8af375ba-20bf-46e5-a1ba-99ec28c49147 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 68c9ec60-9f75-4491-a780-6c339cc6d445] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:53:01.447210 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8af375ba-20bf-46e5-a1ba-99ec28c49147 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:01.447660 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8af375ba-20bf-46e5-a1ba-99ec28c49147 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:01.448439 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8af375ba-20bf-46e5-a1ba-99ec28c49147 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:01.448856 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8af375ba-20bf-46e5-a1ba-99ec28c49147 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:01.599757 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-8af375ba-20bf-46e5-a1ba-99ec28c49147 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:01.609190 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-8af375ba-20bf-46e5-a1ba-99ec28c49147 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:01.611334 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-8af375ba-20bf-46e5-a1ba-99ec28c49147 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:01.612769 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-8af375ba-20bf-46e5-a1ba-99ec28c49147 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445" status: 200 len: 1738 microversion: 2.20 time: 0.181932 Jul 21 10:53:01.613560 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 407/825] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:53:01 2022] GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445 => generated 1738 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:53:01.833324 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-39c8995e-767d-4a48-8a5e-caa9309463a9 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:53:01.834172 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-39c8995e-767d-4a48-8a5e-caa9309463a9 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] [instance: eb24f843-eeb3-43dd-bd48-3bcf68e344cd] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:53:01.841289 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-39c8995e-767d-4a48-8a5e-caa9309463a9 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:01.842246 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-39c8995e-767d-4a48-8a5e-caa9309463a9 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:01.843091 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-39c8995e-767d-4a48-8a5e-caa9309463a9 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:01.843547 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-39c8995e-767d-4a48-8a5e-caa9309463a9 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:01.988936 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-39c8995e-767d-4a48-8a5e-caa9309463a9 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e3fd195fd14b009ba56950dc542cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620ea9c4eaa74dc5858cf93d9fcad9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:01.996976 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-39c8995e-767d-4a48-8a5e-caa9309463a9 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] 10.222.0.48 "GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd" status: 200 len: 1570 microversion: 2.1 time: 0.167898 Jul 21 10:53:02.001023 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 419/826] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:53:01 2022] GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd => generated 1570 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:53:02.631813 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-ce296a6a-95f7-4418-ac6a-2221f8a8926a tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:53:02.632345 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-ce296a6a-95f7-4418-ac6a-2221f8a8926a tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 68c9ec60-9f75-4491-a780-6c339cc6d445] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:53:02.639602 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ce296a6a-95f7-4418-ac6a-2221f8a8926a tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:02.640047 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ce296a6a-95f7-4418-ac6a-2221f8a8926a tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:02.640801 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ce296a6a-95f7-4418-ac6a-2221f8a8926a tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:02.641236 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ce296a6a-95f7-4418-ac6a-2221f8a8926a tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:02.798166 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-ce296a6a-95f7-4418-ac6a-2221f8a8926a tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:02.808878 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-ce296a6a-95f7-4418-ac6a-2221f8a8926a tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:02.810853 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-ce296a6a-95f7-4418-ac6a-2221f8a8926a tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:02.812064 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-ce296a6a-95f7-4418-ac6a-2221f8a8926a tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445" status: 200 len: 1738 microversion: 2.20 time: 0.184196 Jul 21 10:53:02.812630 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 408/827] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:53:02 2022] GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445 => generated 1738 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 10:53:03.019061 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-f2dc756a-818f-41a8-8911-c27068088abb tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:53:03.020371 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-f2dc756a-818f-41a8-8911-c27068088abb tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] [instance: eb24f843-eeb3-43dd-bd48-3bcf68e344cd] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:53:03.026448 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f2dc756a-818f-41a8-8911-c27068088abb tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:03.027149 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f2dc756a-818f-41a8-8911-c27068088abb tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:03.028060 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f2dc756a-818f-41a8-8911-c27068088abb tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:03.028664 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f2dc756a-818f-41a8-8911-c27068088abb tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:03.174946 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-f2dc756a-818f-41a8-8911-c27068088abb tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e3fd195fd14b009ba56950dc542cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620ea9c4eaa74dc5858cf93d9fcad9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:03.183346 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-f2dc756a-818f-41a8-8911-c27068088abb tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] 10.222.0.48 "GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd" status: 200 len: 1570 microversion: 2.1 time: 0.169904 Jul 21 10:53:03.184563 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 420/828] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:53:03 2022] GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd => generated 1570 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:53:03.830345 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-111b503c-d429-4d88-aac2-323d99fdd49f tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:53:03.840225 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-111b503c-d429-4d88-aac2-323d99fdd49f tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 68c9ec60-9f75-4491-a780-6c339cc6d445] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:53:03.840225 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-111b503c-d429-4d88-aac2-323d99fdd49f tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:03.840225 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-111b503c-d429-4d88-aac2-323d99fdd49f tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:03.840225 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-111b503c-d429-4d88-aac2-323d99fdd49f tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:03.840975 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-111b503c-d429-4d88-aac2-323d99fdd49f tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:03.998048 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-111b503c-d429-4d88-aac2-323d99fdd49f tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:04.007035 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-111b503c-d429-4d88-aac2-323d99fdd49f tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:04.008562 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-111b503c-d429-4d88-aac2-323d99fdd49f tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:04.009723 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-111b503c-d429-4d88-aac2-323d99fdd49f tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445" status: 200 len: 1738 microversion: 2.20 time: 0.184334 Jul 21 10:53:04.010811 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 409/829] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:53:03 2022] GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445 => generated 1738 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:53:04.201685 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-972c1ceb-944c-42d9-a738-009a8e17d669 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:53:04.202510 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-972c1ceb-944c-42d9-a738-009a8e17d669 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] [instance: eb24f843-eeb3-43dd-bd48-3bcf68e344cd] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:53:04.209457 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-972c1ceb-944c-42d9-a738-009a8e17d669 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:04.210052 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-972c1ceb-944c-42d9-a738-009a8e17d669 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:04.210904 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-972c1ceb-944c-42d9-a738-009a8e17d669 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:04.211411 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-972c1ceb-944c-42d9-a738-009a8e17d669 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:04.365676 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-972c1ceb-944c-42d9-a738-009a8e17d669 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e3fd195fd14b009ba56950dc542cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620ea9c4eaa74dc5858cf93d9fcad9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:04.374793 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-972c1ceb-944c-42d9-a738-009a8e17d669 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] 10.222.0.48 "GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd" status: 200 len: 1570 microversion: 2.1 time: 0.176847 Jul 21 10:53:04.375539 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 421/830] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:53:04 2022] GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd => generated 1570 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:53:05.027040 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-21f60650-2b64-472d-9250-7ef36b25837c tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:53:05.027889 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-21f60650-2b64-472d-9250-7ef36b25837c tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 68c9ec60-9f75-4491-a780-6c339cc6d445] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:53:05.035191 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-21f60650-2b64-472d-9250-7ef36b25837c tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:05.035982 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-21f60650-2b64-472d-9250-7ef36b25837c tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:05.036994 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-21f60650-2b64-472d-9250-7ef36b25837c tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:05.037511 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-21f60650-2b64-472d-9250-7ef36b25837c tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:05.185978 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-21f60650-2b64-472d-9250-7ef36b25837c tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:05.194275 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-21f60650-2b64-472d-9250-7ef36b25837c tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:05.195846 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-21f60650-2b64-472d-9250-7ef36b25837c tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:05.197086 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-21f60650-2b64-472d-9250-7ef36b25837c tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445" status: 200 len: 1738 microversion: 2.20 time: 0.173909 Jul 21 10:53:05.197653 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 410/831] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:53:05 2022] GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445 => generated 1738 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:53:05.392878 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-f84d7af2-fbee-4059-94c3-c10084ca1bb5 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:53:05.393517 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-f84d7af2-fbee-4059-94c3-c10084ca1bb5 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] [instance: eb24f843-eeb3-43dd-bd48-3bcf68e344cd] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:53:05.400265 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f84d7af2-fbee-4059-94c3-c10084ca1bb5 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:05.400712 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f84d7af2-fbee-4059-94c3-c10084ca1bb5 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:05.401478 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f84d7af2-fbee-4059-94c3-c10084ca1bb5 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:05.401910 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f84d7af2-fbee-4059-94c3-c10084ca1bb5 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:05.541218 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-f84d7af2-fbee-4059-94c3-c10084ca1bb5 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e3fd195fd14b009ba56950dc542cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620ea9c4eaa74dc5858cf93d9fcad9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:05.549313 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-f84d7af2-fbee-4059-94c3-c10084ca1bb5 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] 10.222.0.48 "GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd" status: 200 len: 1570 microversion: 2.1 time: 0.160838 Jul 21 10:53:05.549886 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 422/832] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:53:05 2022] GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd => generated 1570 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:53:06.216581 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-6fac11b1-5836-4c38-861a-f070a8bbd73f tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:53:06.217461 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-6fac11b1-5836-4c38-861a-f070a8bbd73f tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 68c9ec60-9f75-4491-a780-6c339cc6d445] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:53:06.225319 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6fac11b1-5836-4c38-861a-f070a8bbd73f tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:06.225915 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6fac11b1-5836-4c38-861a-f070a8bbd73f tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:06.226779 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6fac11b1-5836-4c38-861a-f070a8bbd73f tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:06.227278 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6fac11b1-5836-4c38-861a-f070a8bbd73f tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:06.386495 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-6fac11b1-5836-4c38-861a-f070a8bbd73f tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:06.397165 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-6fac11b1-5836-4c38-861a-f070a8bbd73f tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:06.398875 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-6fac11b1-5836-4c38-861a-f070a8bbd73f tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:06.400068 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-6fac11b1-5836-4c38-861a-f070a8bbd73f tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445" status: 200 len: 1738 microversion: 2.20 time: 0.188468 Jul 21 10:53:06.410348 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 411/833] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:53:06 2022] GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445 => generated 1738 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:53:06.567404 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-f8854736-9cc7-489c-aedc-e028dc022fdc tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:53:06.567958 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-f8854736-9cc7-489c-aedc-e028dc022fdc tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] [instance: eb24f843-eeb3-43dd-bd48-3bcf68e344cd] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:53:06.570499 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_api:SELECT=53,nova_api:DELETE=1 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:53:06.575997 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f8854736-9cc7-489c-aedc-e028dc022fdc tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:06.579661 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f8854736-9cc7-489c-aedc-e028dc022fdc tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:06.579661 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f8854736-9cc7-489c-aedc-e028dc022fdc tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:06.579661 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f8854736-9cc7-489c-aedc-e028dc022fdc tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:06.716232 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-f8854736-9cc7-489c-aedc-e028dc022fdc tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e3fd195fd14b009ba56950dc542cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620ea9c4eaa74dc5858cf93d9fcad9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:06.724440 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-f8854736-9cc7-489c-aedc-e028dc022fdc tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] 10.222.0.48 "GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd" status: 200 len: 1570 microversion: 2.1 time: 0.161146 Jul 21 10:53:06.725006 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 423/834] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:53:06 2022] GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd => generated 1570 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:53:07.419411 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-cbf5e2fa-8ffe-4329-8743-6dbccb7a027e tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:53:07.420028 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-cbf5e2fa-8ffe-4329-8743-6dbccb7a027e tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 68c9ec60-9f75-4491-a780-6c339cc6d445] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:53:07.427035 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-cbf5e2fa-8ffe-4329-8743-6dbccb7a027e tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:07.427358 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-cbf5e2fa-8ffe-4329-8743-6dbccb7a027e tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:07.428131 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-cbf5e2fa-8ffe-4329-8743-6dbccb7a027e tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:07.428566 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-cbf5e2fa-8ffe-4329-8743-6dbccb7a027e tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:07.567340 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-cbf5e2fa-8ffe-4329-8743-6dbccb7a027e tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:07.575285 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-cbf5e2fa-8ffe-4329-8743-6dbccb7a027e tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:07.576782 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-cbf5e2fa-8ffe-4329-8743-6dbccb7a027e tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:07.578604 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-cbf5e2fa-8ffe-4329-8743-6dbccb7a027e tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445" status: 200 len: 1738 microversion: 2.20 time: 0.163077 Jul 21 10:53:07.579164 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 412/835] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:53:07 2022] GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445 => generated 1738 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:53:07.742668 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-66e833f5-41fa-48b3-acd0-99b204eb8737 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:53:07.743344 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-66e833f5-41fa-48b3-acd0-99b204eb8737 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] [instance: eb24f843-eeb3-43dd-bd48-3bcf68e344cd] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:53:07.750488 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-66e833f5-41fa-48b3-acd0-99b204eb8737 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:07.750989 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-66e833f5-41fa-48b3-acd0-99b204eb8737 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:07.751760 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-66e833f5-41fa-48b3-acd0-99b204eb8737 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:07.752196 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-66e833f5-41fa-48b3-acd0-99b204eb8737 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:07.889728 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-66e833f5-41fa-48b3-acd0-99b204eb8737 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e3fd195fd14b009ba56950dc542cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620ea9c4eaa74dc5858cf93d9fcad9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:07.897973 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-66e833f5-41fa-48b3-acd0-99b204eb8737 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] 10.222.0.48 "GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd" status: 200 len: 1570 microversion: 2.1 time: 0.159769 Jul 21 10:53:07.898566 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 424/836] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:53:07 2022] GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd => generated 1570 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:53:08.596091 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-7dd1cb3b-3682-4ca0-bb6d-10527a8f20d3 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:53:08.597334 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-7dd1cb3b-3682-4ca0-bb6d-10527a8f20d3 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 68c9ec60-9f75-4491-a780-6c339cc6d445] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:53:08.604469 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7dd1cb3b-3682-4ca0-bb6d-10527a8f20d3 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:08.604906 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7dd1cb3b-3682-4ca0-bb6d-10527a8f20d3 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:08.605559 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7dd1cb3b-3682-4ca0-bb6d-10527a8f20d3 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:08.605994 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7dd1cb3b-3682-4ca0-bb6d-10527a8f20d3 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:08.739304 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-7dd1cb3b-3682-4ca0-bb6d-10527a8f20d3 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:08.747142 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-7dd1cb3b-3682-4ca0-bb6d-10527a8f20d3 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:08.748654 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-7dd1cb3b-3682-4ca0-bb6d-10527a8f20d3 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:08.749856 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-7dd1cb3b-3682-4ca0-bb6d-10527a8f20d3 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445" status: 200 len: 1720 microversion: 2.20 time: 0.157790 Jul 21 10:53:08.750414 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 413/837] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:53:08 2022] GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445 => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:53:08.915503 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-eb326791-c0e7-4dbf-bcd4-53281d2fa2c7 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:53:08.916107 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-eb326791-c0e7-4dbf-bcd4-53281d2fa2c7 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] [instance: eb24f843-eeb3-43dd-bd48-3bcf68e344cd] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:53:08.922424 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-eb326791-c0e7-4dbf-bcd4-53281d2fa2c7 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:08.922902 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-eb326791-c0e7-4dbf-bcd4-53281d2fa2c7 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:08.923676 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-eb326791-c0e7-4dbf-bcd4-53281d2fa2c7 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:08.924096 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-eb326791-c0e7-4dbf-bcd4-53281d2fa2c7 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:09.061739 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-eb326791-c0e7-4dbf-bcd4-53281d2fa2c7 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e3fd195fd14b009ba56950dc542cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620ea9c4eaa74dc5858cf93d9fcad9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:09.069420 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-eb326791-c0e7-4dbf-bcd4-53281d2fa2c7 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] 10.222.0.48 "GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd" status: 200 len: 1570 microversion: 2.1 time: 0.157749 Jul 21 10:53:09.069978 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 425/838] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:53:08 2022] GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd => generated 1570 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:53:09.769329 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-bace45d3-76a8-4a7e-951f-fc662a9bcc8d tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:53:09.769944 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-bace45d3-76a8-4a7e-951f-fc662a9bcc8d tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 68c9ec60-9f75-4491-a780-6c339cc6d445] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:53:09.776718 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-bace45d3-76a8-4a7e-951f-fc662a9bcc8d tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:09.777216 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-bace45d3-76a8-4a7e-951f-fc662a9bcc8d tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:09.777968 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-bace45d3-76a8-4a7e-951f-fc662a9bcc8d tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:09.778399 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-bace45d3-76a8-4a7e-951f-fc662a9bcc8d tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:09.910199 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-bace45d3-76a8-4a7e-951f-fc662a9bcc8d tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:09.918636 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-bace45d3-76a8-4a7e-951f-fc662a9bcc8d tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:09.920165 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-bace45d3-76a8-4a7e-951f-fc662a9bcc8d tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:09.921687 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-bace45d3-76a8-4a7e-951f-fc662a9bcc8d tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445" status: 200 len: 1720 microversion: 2.20 time: 0.156518 Jul 21 10:53:09.922315 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 414/839] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:53:09 2022] GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445 => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:53:10.087539 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-ba8d84b8-c3a2-4d39-b7c8-315fe0ed8314 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:53:10.088220 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-ba8d84b8-c3a2-4d39-b7c8-315fe0ed8314 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] [instance: eb24f843-eeb3-43dd-bd48-3bcf68e344cd] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:53:10.095410 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ba8d84b8-c3a2-4d39-b7c8-315fe0ed8314 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:10.095856 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ba8d84b8-c3a2-4d39-b7c8-315fe0ed8314 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:10.096611 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ba8d84b8-c3a2-4d39-b7c8-315fe0ed8314 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:10.097042 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ba8d84b8-c3a2-4d39-b7c8-315fe0ed8314 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:10.233104 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-ba8d84b8-c3a2-4d39-b7c8-315fe0ed8314 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e3fd195fd14b009ba56950dc542cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620ea9c4eaa74dc5858cf93d9fcad9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:10.241373 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-ba8d84b8-c3a2-4d39-b7c8-315fe0ed8314 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] 10.222.0.48 "GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd" status: 200 len: 1570 microversion: 2.1 time: 0.157744 Jul 21 10:53:10.241940 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 426/840] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:53:10 2022] GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd => generated 1570 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:53:10.940117 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-561ff019-e92e-41d5-893e-de2ab9e44ea6 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:53:10.940754 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-561ff019-e92e-41d5-893e-de2ab9e44ea6 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 68c9ec60-9f75-4491-a780-6c339cc6d445] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:53:10.947293 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-561ff019-e92e-41d5-893e-de2ab9e44ea6 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:10.947735 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-561ff019-e92e-41d5-893e-de2ab9e44ea6 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:10.948488 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-561ff019-e92e-41d5-893e-de2ab9e44ea6 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:10.948915 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-561ff019-e92e-41d5-893e-de2ab9e44ea6 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:11.084833 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-561ff019-e92e-41d5-893e-de2ab9e44ea6 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:11.093078 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-561ff019-e92e-41d5-893e-de2ab9e44ea6 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:11.094693 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-561ff019-e92e-41d5-893e-de2ab9e44ea6 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:11.095839 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-561ff019-e92e-41d5-893e-de2ab9e44ea6 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445" status: 200 len: 1723 microversion: 2.20 time: 0.160432 Jul 21 10:53:11.096408 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 415/841] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:53:10 2022] GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:53:11.113826 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-c7356806-4684-43d6-992e-b850eb5ba2ba tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "94d535a6-197a-495f-b0bb-7cc5991e451e"}} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:53:11.114971 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-c7356806-4684-43d6-992e-b850eb5ba2ba tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 68c9ec60-9f75-4491-a780-6c339cc6d445] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:53:11.121588 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c7356806-4684-43d6-992e-b850eb5ba2ba tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:11.122147 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c7356806-4684-43d6-992e-b850eb5ba2ba tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:11.122865 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c7356806-4684-43d6-992e-b850eb5ba2ba tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:11.123370 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c7356806-4684-43d6-992e-b850eb5ba2ba tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:11.259067 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-ddcb794e-3d09-4241-9fa9-2c8adb947be9 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:53:11.259677 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-ddcb794e-3d09-4241-9fa9-2c8adb947be9 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] [instance: eb24f843-eeb3-43dd-bd48-3bcf68e344cd] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:53:11.266088 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ddcb794e-3d09-4241-9fa9-2c8adb947be9 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:11.266553 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ddcb794e-3d09-4241-9fa9-2c8adb947be9 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:11.267379 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ddcb794e-3d09-4241-9fa9-2c8adb947be9 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:11.267816 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ddcb794e-3d09-4241-9fa9-2c8adb947be9 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:11.401510 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-ddcb794e-3d09-4241-9fa9-2c8adb947be9 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e3fd195fd14b009ba56950dc542cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620ea9c4eaa74dc5858cf93d9fcad9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:11.410113 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-ddcb794e-3d09-4241-9fa9-2c8adb947be9 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] 10.222.0.48 "GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd" status: 200 len: 1570 microversion: 2.1 time: 0.155101 Jul 21 10:53:11.411021 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 416/842] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:53:11 2022] GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:53:12.017080 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-c7356806-4684-43d6-992e-b850eb5ba2ba tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "POST /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.907812 Jul 21 10:53:12.017712 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 427/843] 10.222.0.48 () {62 vars in 1363 bytes} [Thu Jul 21 10:53:11 2022] POST /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445/os-volume_attachments => generated 188 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 10:53:12.139117 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-3d53f561-5109-4404-9d2b-d56f092c8604 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:53:12.139615 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-3d53f561-5109-4404-9d2b-d56f092c8604 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 68c9ec60-9f75-4491-a780-6c339cc6d445] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:53:12.146746 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3d53f561-5109-4404-9d2b-d56f092c8604 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:12.147194 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3d53f561-5109-4404-9d2b-d56f092c8604 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:12.147950 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3d53f561-5109-4404-9d2b-d56f092c8604 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:12.148384 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3d53f561-5109-4404-9d2b-d56f092c8604 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:12.327935 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:53:12.427236 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-631e0393-550a-4bce-9880-afc2bcfff770 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:53:12.427839 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-631e0393-550a-4bce-9880-afc2bcfff770 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] [instance: eb24f843-eeb3-43dd-bd48-3bcf68e344cd] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:53:12.434792 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-631e0393-550a-4bce-9880-afc2bcfff770 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:12.435225 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-631e0393-550a-4bce-9880-afc2bcfff770 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:12.435984 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-631e0393-550a-4bce-9880-afc2bcfff770 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:12.436411 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-631e0393-550a-4bce-9880-afc2bcfff770 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:12.578663 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-631e0393-550a-4bce-9880-afc2bcfff770 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e3fd195fd14b009ba56950dc542cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620ea9c4eaa74dc5858cf93d9fcad9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:12.580096 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell1:UPDATE=6,nova_cell1:SELECT=90,nova_cell1:INSERT=4 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:53:12.586378 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-631e0393-550a-4bce-9880-afc2bcfff770 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] 10.222.0.48 "GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd" status: 200 len: 1570 microversion: 2.1 time: 0.162973 Jul 21 10:53:12.587008 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 428/844] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:53:12 2022] GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd => generated 1570 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:53:12.683579 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [req-397869f2-d858-4794-88d2-4e527cf35959 req-b2d92973-b9f0-49b8-94de-41b1ec4aa8c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68c9ec60-9f75-4491-a780-6c339cc6d445", "name": "network-vif-unplugged", "status": "completed", "tag": "767a932c-587b-4501-b928-eef9dd00de9e"}]} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:53:12.691006 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-3d53f561-5109-4404-9d2b-d56f092c8604 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "DELETE /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445/os-volume_attachments/94d535a6-197a-495f-b0bb-7cc5991e451e" status: 202 len: 0 microversion: 2.20 time: 0.555700 Jul 21 10:53:12.692017 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 417/845] 10.222.0.48 () {60 vars in 1456 bytes} [Thu Jul 21 10:53:12 2022] DELETE /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445/os-volume_attachments/94d535a6-197a-495f-b0bb-7cc5991e451e => generated 0 bytes in 558 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 21 10:53:12.695529 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-397869f2-d858-4794-88d2-4e527cf35959 req-b2d92973-b9f0-49b8-94de-41b1ec4aa8c1 service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:12.697882 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-397869f2-d858-4794-88d2-4e527cf35959 req-b2d92973-b9f0-49b8-94de-41b1ec4aa8c1 service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:12.708925 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.compute.server_external_events [req-397869f2-d858-4794-88d2-4e527cf35959 req-b2d92973-b9f0-49b8-94de-41b1ec4aa8c1 service nova] Unable to find a host for instance 68c9ec60-9f75-4491-a780-6c339cc6d445. Dropping event network-vif-unplugged {{(pid=124867) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 21 10:53:12.709947 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [req-397869f2-d858-4794-88d2-4e527cf35959 req-b2d92973-b9f0-49b8-94de-41b1ec4aa8c1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030265 Jul 21 10:53:12.710636 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 429/846] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 21 10:53:12 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 32 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jul 21 10:53:12.756656 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-8154a4b3-dd86-4c97-9dfd-5108c03ced41 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:53:12.757226 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-8154a4b3-dd86-4c97-9dfd-5108c03ced41 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 68c9ec60-9f75-4491-a780-6c339cc6d445] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:53:12.763405 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8154a4b3-dd86-4c97-9dfd-5108c03ced41 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:12.763843 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8154a4b3-dd86-4c97-9dfd-5108c03ced41 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:12.764692 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8154a4b3-dd86-4c97-9dfd-5108c03ced41 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:12.765119 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8154a4b3-dd86-4c97-9dfd-5108c03ced41 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:13.155778 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-8154a4b3-dd86-4c97-9dfd-5108c03ced41 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "POST /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445/action" status: 202 len: 0 microversion: 2.20 time: 0.403105 Jul 21 10:53:13.157171 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 418/847] 10.222.0.48 () {62 vars in 1318 bytes} [Thu Jul 21 10:53:12 2022] POST /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445/action => generated 0 bytes in 405 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 21 10:53:13.165593 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-ec36f798-11ef-4850-83fe-ae1e5b4631a6 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:53:13.166219 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-ec36f798-11ef-4850-83fe-ae1e5b4631a6 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 68c9ec60-9f75-4491-a780-6c339cc6d445] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:53:13.173506 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ec36f798-11ef-4850-83fe-ae1e5b4631a6 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:13.173996 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ec36f798-11ef-4850-83fe-ae1e5b4631a6 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:13.174761 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ec36f798-11ef-4850-83fe-ae1e5b4631a6 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:13.175194 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ec36f798-11ef-4850-83fe-ae1e5b4631a6 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:13.305122 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-ec36f798-11ef-4850-83fe-ae1e5b4631a6 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:13.315428 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-ec36f798-11ef-4850-83fe-ae1e5b4631a6 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:13.317071 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-ec36f798-11ef-4850-83fe-ae1e5b4631a6 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:13.318405 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-ec36f798-11ef-4850-83fe-ae1e5b4631a6 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445" status: 200 len: 1671 microversion: 2.20 time: 0.157419 Jul 21 10:53:13.319006 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 430/848] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:53:13 2022] GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445 => generated 1671 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 10:53:13.604515 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-0e01069b-9d4a-4c3e-81dc-1c7c04defed5 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:53:13.605163 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-0e01069b-9d4a-4c3e-81dc-1c7c04defed5 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] [instance: eb24f843-eeb3-43dd-bd48-3bcf68e344cd] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:53:13.611797 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0e01069b-9d4a-4c3e-81dc-1c7c04defed5 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:13.612249 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0e01069b-9d4a-4c3e-81dc-1c7c04defed5 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:13.613009 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0e01069b-9d4a-4c3e-81dc-1c7c04defed5 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:13.613443 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0e01069b-9d4a-4c3e-81dc-1c7c04defed5 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:13.748303 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-0e01069b-9d4a-4c3e-81dc-1c7c04defed5 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e3fd195fd14b009ba56950dc542cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620ea9c4eaa74dc5858cf93d9fcad9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:13.756930 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-0e01069b-9d4a-4c3e-81dc-1c7c04defed5 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] 10.222.0.48 "GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd" status: 200 len: 1570 microversion: 2.1 time: 0.156291 Jul 21 10:53:13.757655 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 419/849] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:53:13 2022] GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd => generated 1570 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:53:14.337097 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-5ca215fe-b48c-4b3e-b38a-c1515e9f4399 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:53:14.337736 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-5ca215fe-b48c-4b3e-b38a-c1515e9f4399 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 68c9ec60-9f75-4491-a780-6c339cc6d445] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:53:14.345033 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5ca215fe-b48c-4b3e-b38a-c1515e9f4399 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:14.345473 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5ca215fe-b48c-4b3e-b38a-c1515e9f4399 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:14.346359 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5ca215fe-b48c-4b3e-b38a-c1515e9f4399 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:14.346810 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5ca215fe-b48c-4b3e-b38a-c1515e9f4399 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:14.477164 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-5ca215fe-b48c-4b3e-b38a-c1515e9f4399 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:14.485106 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-5ca215fe-b48c-4b3e-b38a-c1515e9f4399 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:14.486638 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-5ca215fe-b48c-4b3e-b38a-c1515e9f4399 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:14.487797 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-5ca215fe-b48c-4b3e-b38a-c1515e9f4399 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445" status: 200 len: 1671 microversion: 2.20 time: 0.154600 Jul 21 10:53:14.488455 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 431/850] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:53:14 2022] GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445 => generated 1671 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:53:14.775090 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-41ab8c72-04b8-46dc-a8bb-144c0b785008 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:53:14.775727 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-41ab8c72-04b8-46dc-a8bb-144c0b785008 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] [instance: eb24f843-eeb3-43dd-bd48-3bcf68e344cd] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:53:14.782837 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-41ab8c72-04b8-46dc-a8bb-144c0b785008 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:14.783286 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-41ab8c72-04b8-46dc-a8bb-144c0b785008 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:14.784043 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-41ab8c72-04b8-46dc-a8bb-144c0b785008 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:14.784479 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-41ab8c72-04b8-46dc-a8bb-144c0b785008 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:14.921521 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-41ab8c72-04b8-46dc-a8bb-144c0b785008 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e3fd195fd14b009ba56950dc542cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620ea9c4eaa74dc5858cf93d9fcad9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:14.929472 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-41ab8c72-04b8-46dc-a8bb-144c0b785008 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] 10.222.0.48 "GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd" status: 200 len: 1570 microversion: 2.1 time: 0.158306 Jul 21 10:53:14.930066 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 420/851] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:53:14 2022] GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd => generated 1570 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:53:15.506335 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-6b8c1584-433b-4440-b4b2-8cd42d4c5263 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:53:15.506971 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-6b8c1584-433b-4440-b4b2-8cd42d4c5263 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 68c9ec60-9f75-4491-a780-6c339cc6d445] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:53:15.513503 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6b8c1584-433b-4440-b4b2-8cd42d4c5263 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:15.513949 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6b8c1584-433b-4440-b4b2-8cd42d4c5263 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:15.514732 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6b8c1584-433b-4440-b4b2-8cd42d4c5263 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:15.515166 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6b8c1584-433b-4440-b4b2-8cd42d4c5263 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:15.644477 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-6b8c1584-433b-4440-b4b2-8cd42d4c5263 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:15.652277 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-6b8c1584-433b-4440-b4b2-8cd42d4c5263 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:15.653784 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-6b8c1584-433b-4440-b4b2-8cd42d4c5263 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:15.654916 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-6b8c1584-433b-4440-b4b2-8cd42d4c5263 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445" status: 200 len: 1671 microversion: 2.20 time: 0.152627 Jul 21 10:53:15.655466 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 432/852] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:53:15 2022] GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445 => generated 1671 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 10:53:15.946391 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-69687c11-7b02-48cc-9ab6-034763ccb13f tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:53:15.947130 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-69687c11-7b02-48cc-9ab6-034763ccb13f tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] [instance: eb24f843-eeb3-43dd-bd48-3bcf68e344cd] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:53:15.953774 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-69687c11-7b02-48cc-9ab6-034763ccb13f tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:15.954213 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-69687c11-7b02-48cc-9ab6-034763ccb13f tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:15.955001 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-69687c11-7b02-48cc-9ab6-034763ccb13f tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:15.955433 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-69687c11-7b02-48cc-9ab6-034763ccb13f tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:16.082784 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-69687c11-7b02-48cc-9ab6-034763ccb13f tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e3fd195fd14b009ba56950dc542cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620ea9c4eaa74dc5858cf93d9fcad9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:16.090428 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-69687c11-7b02-48cc-9ab6-034763ccb13f tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] 10.222.0.48 "GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd" status: 200 len: 1570 microversion: 2.1 time: 0.147878 Jul 21 10:53:16.091008 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 421/853] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:53:15 2022] GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd => generated 1570 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:53:16.673442 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-2d50c9fd-255c-48a6-aaf9-f9f4e231a48c tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:53:16.674049 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-2d50c9fd-255c-48a6-aaf9-f9f4e231a48c tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 68c9ec60-9f75-4491-a780-6c339cc6d445] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:53:16.680548 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2d50c9fd-255c-48a6-aaf9-f9f4e231a48c tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:16.680991 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2d50c9fd-255c-48a6-aaf9-f9f4e231a48c tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:16.681744 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2d50c9fd-255c-48a6-aaf9-f9f4e231a48c tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:16.682176 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2d50c9fd-255c-48a6-aaf9-f9f4e231a48c tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:16.813506 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-2d50c9fd-255c-48a6-aaf9-f9f4e231a48c tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:16.821202 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-2d50c9fd-255c-48a6-aaf9-f9f4e231a48c tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:16.822715 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-2d50c9fd-255c-48a6-aaf9-f9f4e231a48c tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:16.823892 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-2d50c9fd-255c-48a6-aaf9-f9f4e231a48c tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445" status: 200 len: 1671 microversion: 2.20 time: 0.154398 Jul 21 10:53:16.824456 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 433/854] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:53:16 2022] GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445 => generated 1671 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:53:17.108224 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-610e2003-20ef-42c8-aba0-8fb514a4cdb7 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:53:17.108863 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-610e2003-20ef-42c8-aba0-8fb514a4cdb7 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] [instance: eb24f843-eeb3-43dd-bd48-3bcf68e344cd] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:53:17.115134 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-610e2003-20ef-42c8-aba0-8fb514a4cdb7 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:17.115583 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-610e2003-20ef-42c8-aba0-8fb514a4cdb7 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:17.116337 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-610e2003-20ef-42c8-aba0-8fb514a4cdb7 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:17.116774 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-610e2003-20ef-42c8-aba0-8fb514a4cdb7 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:17.249611 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-610e2003-20ef-42c8-aba0-8fb514a4cdb7 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e3fd195fd14b009ba56950dc542cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620ea9c4eaa74dc5858cf93d9fcad9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:17.257928 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-610e2003-20ef-42c8-aba0-8fb514a4cdb7 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] 10.222.0.48 "GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd" status: 200 len: 1570 microversion: 2.1 time: 0.153529 Jul 21 10:53:17.258488 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 422/855] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:53:17 2022] GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:53:17.611169 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-575176b7-f11c-4529-b8ed-424fe115873e tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:53:17.611596 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-575176b7-f11c-4529-b8ed-424fe115873e tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 1457b868-0630-42f6-958c-da6d5bbab2ce] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:53:17.617506 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-575176b7-f11c-4529-b8ed-424fe115873e tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:17.617952 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-575176b7-f11c-4529-b8ed-424fe115873e tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:17.618738 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-575176b7-f11c-4529-b8ed-424fe115873e tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:17.619179 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-575176b7-f11c-4529-b8ed-424fe115873e tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:17.641605 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-575176b7-f11c-4529-b8ed-424fe115873e tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/1457b868-0630-42f6-958c-da6d5bbab2ce/ips" status: 200 len: 150 microversion: 2.1 time: 0.035147 Jul 21 10:53:17.642167 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 434/856] 10.222.0.48 () {58 vars in 1247 bytes} [Thu Jul 21 10:53:17 2022] GET /compute/v2.1/servers/1457b868-0630-42f6-958c-da6d5bbab2ce/ips => generated 150 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:53:17.843221 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-033022f4-b1d1-4d3f-838c-44e8a92f11c0 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:53:17.844400 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-033022f4-b1d1-4d3f-838c-44e8a92f11c0 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 68c9ec60-9f75-4491-a780-6c339cc6d445] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:53:17.850620 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-033022f4-b1d1-4d3f-838c-44e8a92f11c0 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:17.851069 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-033022f4-b1d1-4d3f-838c-44e8a92f11c0 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:17.851833 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-033022f4-b1d1-4d3f-838c-44e8a92f11c0 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:17.852263 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-033022f4-b1d1-4d3f-838c-44e8a92f11c0 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:17.994818 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-033022f4-b1d1-4d3f-838c-44e8a92f11c0 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:18.006070 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-033022f4-b1d1-4d3f-838c-44e8a92f11c0 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:18.007903 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-033022f4-b1d1-4d3f-838c-44e8a92f11c0 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:18.009205 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-033022f4-b1d1-4d3f-838c-44e8a92f11c0 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445" status: 200 len: 1671 microversion: 2.20 time: 0.169945 Jul 21 10:53:18.010061 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 423/857] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:53:17 2022] GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445 => generated 1671 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:53:18.275187 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-1c024c47-8f27-4031-8691-dc30d4b0bc5a tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:53:18.275776 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-1c024c47-8f27-4031-8691-dc30d4b0bc5a tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] [instance: eb24f843-eeb3-43dd-bd48-3bcf68e344cd] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:53:18.282637 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1c024c47-8f27-4031-8691-dc30d4b0bc5a tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:18.283064 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1c024c47-8f27-4031-8691-dc30d4b0bc5a tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:18.283817 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1c024c47-8f27-4031-8691-dc30d4b0bc5a tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:18.284245 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1c024c47-8f27-4031-8691-dc30d4b0bc5a tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:18.423176 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-1c024c47-8f27-4031-8691-dc30d4b0bc5a tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e3fd195fd14b009ba56950dc542cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620ea9c4eaa74dc5858cf93d9fcad9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:18.430673 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-1c024c47-8f27-4031-8691-dc30d4b0bc5a tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] 10.222.0.48 "GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd" status: 200 len: 1570 microversion: 2.1 time: 0.159519 Jul 21 10:53:18.431247 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 435/858] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:53:18 2022] GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd => generated 1570 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:53:19.027817 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-36d1bd58-2086-44e2-bf88-68656bef0866 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:53:19.028702 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-36d1bd58-2086-44e2-bf88-68656bef0866 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 68c9ec60-9f75-4491-a780-6c339cc6d445] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:53:19.036185 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-36d1bd58-2086-44e2-bf88-68656bef0866 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:19.036636 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-36d1bd58-2086-44e2-bf88-68656bef0866 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:19.037401 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-36d1bd58-2086-44e2-bf88-68656bef0866 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:19.037835 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-36d1bd58-2086-44e2-bf88-68656bef0866 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:19.166973 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-36d1bd58-2086-44e2-bf88-68656bef0866 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:19.175443 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-36d1bd58-2086-44e2-bf88-68656bef0866 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:19.176995 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-36d1bd58-2086-44e2-bf88-68656bef0866 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:19.178156 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-36d1bd58-2086-44e2-bf88-68656bef0866 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445" status: 200 len: 1729 microversion: 2.20 time: 0.154214 Jul 21 10:53:19.178756 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 424/859] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:53:19 2022] GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445 => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:53:19.212268 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-86ab416b-20e9-4e66-8bbd-8b7fd12e112b tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f7267206-ca18-4ed7-92f2-cc87916241e0"}} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:53:19.213686 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-86ab416b-20e9-4e66-8bbd-8b7fd12e112b tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 1457b868-0630-42f6-958c-da6d5bbab2ce] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:53:19.220666 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-86ab416b-20e9-4e66-8bbd-8b7fd12e112b tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:19.221170 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-86ab416b-20e9-4e66-8bbd-8b7fd12e112b tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:19.226402 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-86ab416b-20e9-4e66-8bbd-8b7fd12e112b tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:19.226402 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-86ab416b-20e9-4e66-8bbd-8b7fd12e112b tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:19.448815 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-6ed6fe1d-56b2-4ce9-9d55-247762440d1b tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:53:19.449446 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-6ed6fe1d-56b2-4ce9-9d55-247762440d1b tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] [instance: eb24f843-eeb3-43dd-bd48-3bcf68e344cd] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:53:19.457030 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6ed6fe1d-56b2-4ce9-9d55-247762440d1b tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:19.457476 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6ed6fe1d-56b2-4ce9-9d55-247762440d1b tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:19.458384 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6ed6fe1d-56b2-4ce9-9d55-247762440d1b tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:19.459007 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6ed6fe1d-56b2-4ce9-9d55-247762440d1b tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:19.606110 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-6ed6fe1d-56b2-4ce9-9d55-247762440d1b tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e3fd195fd14b009ba56950dc542cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620ea9c4eaa74dc5858cf93d9fcad9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:19.613927 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-6ed6fe1d-56b2-4ce9-9d55-247762440d1b tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] 10.222.0.48 "GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd" status: 200 len: 1570 microversion: 2.1 time: 0.169158 Jul 21 10:53:19.614497 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 425/860] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:53:19 2022] GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd => generated 1570 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:53:20.196675 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-7f4d19cf-4ddf-4c5c-bd24-8363e2c0d186 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:53:20.197352 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-7f4d19cf-4ddf-4c5c-bd24-8363e2c0d186 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 68c9ec60-9f75-4491-a780-6c339cc6d445] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:53:20.203958 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7f4d19cf-4ddf-4c5c-bd24-8363e2c0d186 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:20.204946 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7f4d19cf-4ddf-4c5c-bd24-8363e2c0d186 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:20.205861 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7f4d19cf-4ddf-4c5c-bd24-8363e2c0d186 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:20.206297 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7f4d19cf-4ddf-4c5c-bd24-8363e2c0d186 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:20.343707 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-7f4d19cf-4ddf-4c5c-bd24-8363e2c0d186 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:20.352336 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-7f4d19cf-4ddf-4c5c-bd24-8363e2c0d186 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:20.353857 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-7f4d19cf-4ddf-4c5c-bd24-8363e2c0d186 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:20.355020 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-7f4d19cf-4ddf-4c5c-bd24-8363e2c0d186 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445" status: 200 len: 1729 microversion: 2.20 time: 0.162367 Jul 21 10:53:20.355568 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 426/861] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:53:20 2022] GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445 => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 10:53:20.495066 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-86ab416b-20e9-4e66-8bbd-8b7fd12e112b tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "POST /compute/v2.1/servers/1457b868-0630-42f6-958c-da6d5bbab2ce/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.286530 Jul 21 10:53:20.500705 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 436/862] 10.222.0.48 () {60 vars in 1322 bytes} [Thu Jul 21 10:53:19 2022] POST /compute/v2.1/servers/1457b868-0630-42f6-958c-da6d5bbab2ce/os-volume_attachments => generated 194 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:53:20.632715 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-4240c970-5bf4-4661-b57a-282ed3da8529 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:53:20.635174 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-4240c970-5bf4-4661-b57a-282ed3da8529 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] [instance: eb24f843-eeb3-43dd-bd48-3bcf68e344cd] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:53:20.649979 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4240c970-5bf4-4661-b57a-282ed3da8529 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:20.651152 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4240c970-5bf4-4661-b57a-282ed3da8529 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:20.654761 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4240c970-5bf4-4661-b57a-282ed3da8529 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:20.655483 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4240c970-5bf4-4661-b57a-282ed3da8529 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:20.662488 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [req-e8368ba4-b7ea-447a-baff-a011f234d973 req-34f265fe-9082-4442-85f6-39adfefb94e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb24f843-eeb3-43dd-bd48-3bcf68e344cd", "name": "network-vif-unplugged", "status": "completed", "tag": "2741d1f0-6bcb-4bee-8842-bc9bf8bc4db2"}]} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:53:20.679104 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-e8368ba4-b7ea-447a-baff-a011f234d973 req-34f265fe-9082-4442-85f6-39adfefb94e7 service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:20.679553 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-e8368ba4-b7ea-447a-baff-a011f234d973 req-34f265fe-9082-4442-85f6-39adfefb94e7 service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:20.696210 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.compute.server_external_events [req-e8368ba4-b7ea-447a-baff-a011f234d973 req-34f265fe-9082-4442-85f6-39adfefb94e7 service nova] Unable to find a host for instance eb24f843-eeb3-43dd-bd48-3bcf68e344cd. Dropping event network-vif-unplugged {{(pid=124867) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 21 10:53:20.697143 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [req-e8368ba4-b7ea-447a-baff-a011f234d973 req-34f265fe-9082-4442-85f6-39adfefb94e7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.038850 Jul 21 10:53:20.697722 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 437/863] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 21 10:53:20 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 40 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jul 21 10:53:20.831894 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-4240c970-5bf4-4661-b57a-282ed3da8529 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e3fd195fd14b009ba56950dc542cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620ea9c4eaa74dc5858cf93d9fcad9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:20.835417 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-4240c970-5bf4-4661-b57a-282ed3da8529 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] 10.222.0.48 "GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd" status: 200 len: 1511 microversion: 2.1 time: 0.206851 Jul 21 10:53:20.836065 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 427/864] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:53:20 2022] GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd => generated 1511 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:53:20.856861 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-2f7c6455-c4ce-49cf-ac08-8670603e8caa tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:53:20.860763 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-2f7c6455-c4ce-49cf-ac08-8670603e8caa tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] [instance: eb24f843-eeb3-43dd-bd48-3bcf68e344cd] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:53:20.867235 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2f7c6455-c4ce-49cf-ac08-8670603e8caa tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:20.867776 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2f7c6455-c4ce-49cf-ac08-8670603e8caa tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:20.868695 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2f7c6455-c4ce-49cf-ac08-8670603e8caa tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:20.869195 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2f7c6455-c4ce-49cf-ac08-8670603e8caa tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:21.100556 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-2f7c6455-c4ce-49cf-ac08-8670603e8caa tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] 10.222.0.48 "POST /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd/action" status: 202 len: 0 microversion: 2.1 time: 0.248192 Jul 21 10:53:21.101423 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 438/865] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 21 10:53:20 2022] POST /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd/action => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 21 10:53:21.109974 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-e48a1922-4dbe-4daf-b449-0da384b91d27 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:53:21.111537 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-e48a1922-4dbe-4daf-b449-0da384b91d27 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] [instance: eb24f843-eeb3-43dd-bd48-3bcf68e344cd] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:53:21.119084 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e48a1922-4dbe-4daf-b449-0da384b91d27 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:21.119729 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e48a1922-4dbe-4daf-b449-0da384b91d27 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:21.120873 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e48a1922-4dbe-4daf-b449-0da384b91d27 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:21.121383 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e48a1922-4dbe-4daf-b449-0da384b91d27 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:21.367422 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-e48a1922-4dbe-4daf-b449-0da384b91d27 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e3fd195fd14b009ba56950dc542cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620ea9c4eaa74dc5858cf93d9fcad9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:21.374375 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-5bf5f8a4-db28-40b0-b6ea-dc000bdeb6d2 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:53:21.375332 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-5bf5f8a4-db28-40b0-b6ea-dc000bdeb6d2 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 68c9ec60-9f75-4491-a780-6c339cc6d445] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:53:21.377652 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-e48a1922-4dbe-4daf-b449-0da384b91d27 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] 10.222.0.48 "GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd" status: 200 len: 1519 microversion: 2.1 time: 0.271813 Jul 21 10:53:21.378494 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 428/866] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:53:21 2022] GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd => generated 1519 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:53:21.387575 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5bf5f8a4-db28-40b0-b6ea-dc000bdeb6d2 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:21.391882 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5bf5f8a4-db28-40b0-b6ea-dc000bdeb6d2 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:21.394077 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5bf5f8a4-db28-40b0-b6ea-dc000bdeb6d2 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:21.394794 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5bf5f8a4-db28-40b0-b6ea-dc000bdeb6d2 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:21.662184 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-5bf5f8a4-db28-40b0-b6ea-dc000bdeb6d2 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:21.672221 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-5bf5f8a4-db28-40b0-b6ea-dc000bdeb6d2 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:21.680134 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-5bf5f8a4-db28-40b0-b6ea-dc000bdeb6d2 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:21.680134 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-5bf5f8a4-db28-40b0-b6ea-dc000bdeb6d2 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445" status: 200 len: 1729 microversion: 2.20 time: 0.307503 Jul 21 10:53:21.680134 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 439/867] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:53:21 2022] GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445 => generated 1729 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:53:22.396406 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-0214043d-4e86-4ede-9f16-74522b1c34c3 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:53:22.397033 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-0214043d-4e86-4ede-9f16-74522b1c34c3 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] [instance: eb24f843-eeb3-43dd-bd48-3bcf68e344cd] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:53:22.404358 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0214043d-4e86-4ede-9f16-74522b1c34c3 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:22.404833 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0214043d-4e86-4ede-9f16-74522b1c34c3 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:22.405797 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0214043d-4e86-4ede-9f16-74522b1c34c3 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:22.406342 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0214043d-4e86-4ede-9f16-74522b1c34c3 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:22.551766 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-0214043d-4e86-4ede-9f16-74522b1c34c3 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e3fd195fd14b009ba56950dc542cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620ea9c4eaa74dc5858cf93d9fcad9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:22.559877 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-0214043d-4e86-4ede-9f16-74522b1c34c3 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] 10.222.0.48 "GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd" status: 200 len: 1519 microversion: 2.1 time: 0.167296 Jul 21 10:53:22.560550 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 429/868] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:53:22 2022] GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd => generated 1519 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:53:22.698108 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-fd6151fc-3756-47de-abb9-de7f21082df4 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:53:22.698687 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-fd6151fc-3756-47de-abb9-de7f21082df4 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 68c9ec60-9f75-4491-a780-6c339cc6d445] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:53:22.706403 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fd6151fc-3756-47de-abb9-de7f21082df4 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:22.706828 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fd6151fc-3756-47de-abb9-de7f21082df4 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:22.708609 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fd6151fc-3756-47de-abb9-de7f21082df4 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:22.709384 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fd6151fc-3756-47de-abb9-de7f21082df4 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:22.911206 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-fd6151fc-3756-47de-abb9-de7f21082df4 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:22.918083 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-fd6151fc-3756-47de-abb9-de7f21082df4 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:22.919745 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-fd6151fc-3756-47de-abb9-de7f21082df4 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:22.921017 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-fd6151fc-3756-47de-abb9-de7f21082df4 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445" status: 200 len: 1729 microversion: 2.20 time: 0.228901 Jul 21 10:53:22.922093 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 440/869] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:53:22 2022] GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445 => generated 1729 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:53:23.577462 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-9eae0ede-c39a-408d-9328-1c9bfc9efa24 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:53:23.578249 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-9eae0ede-c39a-408d-9328-1c9bfc9efa24 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] [instance: eb24f843-eeb3-43dd-bd48-3bcf68e344cd] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:53:23.585724 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9eae0ede-c39a-408d-9328-1c9bfc9efa24 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:23.586524 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9eae0ede-c39a-408d-9328-1c9bfc9efa24 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:23.587552 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9eae0ede-c39a-408d-9328-1c9bfc9efa24 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:23.588340 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9eae0ede-c39a-408d-9328-1c9bfc9efa24 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:23.763638 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-9eae0ede-c39a-408d-9328-1c9bfc9efa24 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e3fd195fd14b009ba56950dc542cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620ea9c4eaa74dc5858cf93d9fcad9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:23.772353 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-9eae0ede-c39a-408d-9328-1c9bfc9efa24 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] 10.222.0.48 "GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd" status: 200 len: 1519 microversion: 2.1 time: 0.198779 Jul 21 10:53:23.782647 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 430/870] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:53:23 2022] GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd => generated 1519 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:53:23.941048 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-c030a9a0-ca0f-4fb5-801f-86c48370972b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:53:23.941751 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-c030a9a0-ca0f-4fb5-801f-86c48370972b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 68c9ec60-9f75-4491-a780-6c339cc6d445] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:53:23.949027 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c030a9a0-ca0f-4fb5-801f-86c48370972b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:23.950585 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c030a9a0-ca0f-4fb5-801f-86c48370972b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:23.950585 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c030a9a0-ca0f-4fb5-801f-86c48370972b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:23.959076 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c030a9a0-ca0f-4fb5-801f-86c48370972b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:24.137384 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-c030a9a0-ca0f-4fb5-801f-86c48370972b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:24.146395 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-c030a9a0-ca0f-4fb5-801f-86c48370972b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:24.148000 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-c030a9a0-ca0f-4fb5-801f-86c48370972b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:24.149163 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-c030a9a0-ca0f-4fb5-801f-86c48370972b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445" status: 200 len: 1729 microversion: 2.20 time: 0.212749 Jul 21 10:53:24.149721 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 441/871] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:53:23 2022] GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445 => generated 1729 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:53:24.790013 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-b4912d95-6316-4eab-b526-8654f758116e tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:53:24.790909 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-b4912d95-6316-4eab-b526-8654f758116e tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] [instance: eb24f843-eeb3-43dd-bd48-3bcf68e344cd] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:53:24.797647 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b4912d95-6316-4eab-b526-8654f758116e tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:24.798505 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b4912d95-6316-4eab-b526-8654f758116e tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:24.799733 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b4912d95-6316-4eab-b526-8654f758116e tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:24.800236 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b4912d95-6316-4eab-b526-8654f758116e tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:24.972772 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-b4912d95-6316-4eab-b526-8654f758116e tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e3fd195fd14b009ba56950dc542cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620ea9c4eaa74dc5858cf93d9fcad9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:24.980566 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-b4912d95-6316-4eab-b526-8654f758116e tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] 10.222.0.48 "GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd" status: 200 len: 1519 microversion: 2.1 time: 0.194293 Jul 21 10:53:24.981140 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 431/872] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:53:24 2022] GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd => generated 1519 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:53:25.169816 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-e5bd7825-7e1c-4355-a1be-bcf19198b2dd tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:53:25.170514 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-e5bd7825-7e1c-4355-a1be-bcf19198b2dd tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 68c9ec60-9f75-4491-a780-6c339cc6d445] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:53:25.179740 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e5bd7825-7e1c-4355-a1be-bcf19198b2dd tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:25.179740 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e5bd7825-7e1c-4355-a1be-bcf19198b2dd tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:25.180575 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e5bd7825-7e1c-4355-a1be-bcf19198b2dd tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:25.181301 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e5bd7825-7e1c-4355-a1be-bcf19198b2dd tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:25.375356 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-e5bd7825-7e1c-4355-a1be-bcf19198b2dd tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:25.383426 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-e5bd7825-7e1c-4355-a1be-bcf19198b2dd tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:25.385004 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-e5bd7825-7e1c-4355-a1be-bcf19198b2dd tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:25.386187 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-e5bd7825-7e1c-4355-a1be-bcf19198b2dd tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445" status: 200 len: 1729 microversion: 2.20 time: 0.220718 Jul 21 10:53:25.386810 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 442/873] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:53:25 2022] GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445 => generated 1729 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:53:25.999279 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-4adb5f79-1299-4ac5-9def-11f475b8e25f tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:53:26.000104 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-4adb5f79-1299-4ac5-9def-11f475b8e25f tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] [instance: eb24f843-eeb3-43dd-bd48-3bcf68e344cd] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:53:26.008678 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4adb5f79-1299-4ac5-9def-11f475b8e25f tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:26.009496 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4adb5f79-1299-4ac5-9def-11f475b8e25f tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:26.010839 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4adb5f79-1299-4ac5-9def-11f475b8e25f tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:26.011645 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4adb5f79-1299-4ac5-9def-11f475b8e25f tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:26.016525 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=94,nova_cell1:UPDATE=4 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:53:26.183785 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-4adb5f79-1299-4ac5-9def-11f475b8e25f tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e3fd195fd14b009ba56950dc542cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620ea9c4eaa74dc5858cf93d9fcad9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:26.192274 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-4adb5f79-1299-4ac5-9def-11f475b8e25f tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] 10.222.0.48 "GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd" status: 200 len: 1519 microversion: 2.1 time: 0.197198 Jul 21 10:53:26.200294 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 432/874] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:53:25 2022] GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd => generated 1519 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:53:26.406109 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-0cb43f67-49fa-4908-8898-a577d6988f56 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:53:26.408752 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-0cb43f67-49fa-4908-8898-a577d6988f56 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 68c9ec60-9f75-4491-a780-6c339cc6d445] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:53:26.416768 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0cb43f67-49fa-4908-8898-a577d6988f56 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:26.417541 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0cb43f67-49fa-4908-8898-a577d6988f56 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:26.418385 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0cb43f67-49fa-4908-8898-a577d6988f56 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:26.419030 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0cb43f67-49fa-4908-8898-a577d6988f56 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:26.585163 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-0cb43f67-49fa-4908-8898-a577d6988f56 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:26.595856 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-0cb43f67-49fa-4908-8898-a577d6988f56 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:26.597929 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-0cb43f67-49fa-4908-8898-a577d6988f56 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:26.603007 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-0cb43f67-49fa-4908-8898-a577d6988f56 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445" status: 200 len: 1729 microversion: 2.20 time: 0.201407 Jul 21 10:53:26.606678 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 443/875] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:53:26 2022] GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445 => generated 1729 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:53:27.209763 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-3b630626-eca2-4ee8-a82e-dae98d46a11b tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:53:27.210570 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-3b630626-eca2-4ee8-a82e-dae98d46a11b tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] [instance: eb24f843-eeb3-43dd-bd48-3bcf68e344cd] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:53:27.213612 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_api:SELECT=66 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:53:27.225617 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3b630626-eca2-4ee8-a82e-dae98d46a11b tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:27.225617 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3b630626-eca2-4ee8-a82e-dae98d46a11b tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:27.225617 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3b630626-eca2-4ee8-a82e-dae98d46a11b tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:27.225617 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3b630626-eca2-4ee8-a82e-dae98d46a11b tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:27.374561 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-3b630626-eca2-4ee8-a82e-dae98d46a11b tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e3fd195fd14b009ba56950dc542cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620ea9c4eaa74dc5858cf93d9fcad9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:27.385553 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-3b630626-eca2-4ee8-a82e-dae98d46a11b tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] 10.222.0.48 "GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd" status: 200 len: 1519 microversion: 2.1 time: 0.179923 Jul 21 10:53:27.386701 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 433/876] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:53:27 2022] GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd => generated 1519 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:53:27.622851 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-35452dd1-c5d8-4504-bd42-86ec8f7982f0 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:53:27.624283 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-35452dd1-c5d8-4504-bd42-86ec8f7982f0 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 68c9ec60-9f75-4491-a780-6c339cc6d445] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:53:27.631939 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-35452dd1-c5d8-4504-bd42-86ec8f7982f0 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:27.632422 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-35452dd1-c5d8-4504-bd42-86ec8f7982f0 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:27.633619 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-35452dd1-c5d8-4504-bd42-86ec8f7982f0 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:27.634518 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-35452dd1-c5d8-4504-bd42-86ec8f7982f0 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:27.802498 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-35452dd1-c5d8-4504-bd42-86ec8f7982f0 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:27.805192 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:53:27.812146 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-35452dd1-c5d8-4504-bd42-86ec8f7982f0 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:27.825859 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-35452dd1-c5d8-4504-bd42-86ec8f7982f0 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:27.825859 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-35452dd1-c5d8-4504-bd42-86ec8f7982f0 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445" status: 200 len: 1729 microversion: 2.20 time: 0.197107 Jul 21 10:53:27.826359 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 444/877] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:53:27 2022] GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445 => generated 1729 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 10:53:28.404042 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-9751ccb2-92e7-486b-9b05-b0032b5c4980 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:53:28.404653 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-9751ccb2-92e7-486b-9b05-b0032b5c4980 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] [instance: eb24f843-eeb3-43dd-bd48-3bcf68e344cd] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:53:28.412819 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9751ccb2-92e7-486b-9b05-b0032b5c4980 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:28.413269 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9751ccb2-92e7-486b-9b05-b0032b5c4980 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:28.414047 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9751ccb2-92e7-486b-9b05-b0032b5c4980 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:28.414480 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9751ccb2-92e7-486b-9b05-b0032b5c4980 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:28.559028 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-9751ccb2-92e7-486b-9b05-b0032b5c4980 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e3fd195fd14b009ba56950dc542cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620ea9c4eaa74dc5858cf93d9fcad9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:28.567434 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-9751ccb2-92e7-486b-9b05-b0032b5c4980 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] 10.222.0.48 "GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd" status: 200 len: 1519 microversion: 2.1 time: 0.167176 Jul 21 10:53:28.568063 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 434/878] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:53:28 2022] GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd => generated 1519 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:53:28.835643 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-39b20aa0-5184-42ab-96cf-85e0e0be10b5 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:53:28.836365 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-39b20aa0-5184-42ab-96cf-85e0e0be10b5 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 68c9ec60-9f75-4491-a780-6c339cc6d445] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:53:28.843526 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-39b20aa0-5184-42ab-96cf-85e0e0be10b5 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:28.843973 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-39b20aa0-5184-42ab-96cf-85e0e0be10b5 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:28.845233 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-39b20aa0-5184-42ab-96cf-85e0e0be10b5 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:28.845797 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-39b20aa0-5184-42ab-96cf-85e0e0be10b5 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:28.976421 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-39b20aa0-5184-42ab-96cf-85e0e0be10b5 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:28.985005 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-39b20aa0-5184-42ab-96cf-85e0e0be10b5 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:28.989597 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-39b20aa0-5184-42ab-96cf-85e0e0be10b5 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:28.989597 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-39b20aa0-5184-42ab-96cf-85e0e0be10b5 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445" status: 200 len: 1729 microversion: 2.20 time: 0.156725 Jul 21 10:53:28.989597 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 445/879] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:53:28 2022] GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445 => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:53:29.584751 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-e76b5167-eb10-4e6c-b54e-ed6e7b3877f7 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:53:29.585338 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-e76b5167-eb10-4e6c-b54e-ed6e7b3877f7 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] [instance: eb24f843-eeb3-43dd-bd48-3bcf68e344cd] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:53:29.592048 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e76b5167-eb10-4e6c-b54e-ed6e7b3877f7 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:29.592499 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e76b5167-eb10-4e6c-b54e-ed6e7b3877f7 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:29.593257 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e76b5167-eb10-4e6c-b54e-ed6e7b3877f7 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:29.593690 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e76b5167-eb10-4e6c-b54e-ed6e7b3877f7 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:29.727696 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-e76b5167-eb10-4e6c-b54e-ed6e7b3877f7 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e3fd195fd14b009ba56950dc542cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620ea9c4eaa74dc5858cf93d9fcad9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:29.737697 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-e76b5167-eb10-4e6c-b54e-ed6e7b3877f7 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] 10.222.0.48 "GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd" status: 200 len: 1519 microversion: 2.1 time: 0.156706 Jul 21 10:53:29.738466 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 435/880] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:53:29 2022] GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:53:30.008111 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-058932cb-ec6b-4997-b621-3ecc3b4ae8c8 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:53:30.008711 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-058932cb-ec6b-4997-b621-3ecc3b4ae8c8 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 68c9ec60-9f75-4491-a780-6c339cc6d445] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:53:30.015193 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-058932cb-ec6b-4997-b621-3ecc3b4ae8c8 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:30.015639 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-058932cb-ec6b-4997-b621-3ecc3b4ae8c8 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:30.016389 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-058932cb-ec6b-4997-b621-3ecc3b4ae8c8 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:30.016879 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-058932cb-ec6b-4997-b621-3ecc3b4ae8c8 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:30.151183 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-058932cb-ec6b-4997-b621-3ecc3b4ae8c8 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:30.161058 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-058932cb-ec6b-4997-b621-3ecc3b4ae8c8 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:30.162457 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-058932cb-ec6b-4997-b621-3ecc3b4ae8c8 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:30.163670 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-058932cb-ec6b-4997-b621-3ecc3b4ae8c8 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445" status: 200 len: 1729 microversion: 2.20 time: 0.159920 Jul 21 10:53:30.164236 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 446/881] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:53:30 2022] GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445 => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:53:30.755378 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-27bd32c9-f689-4acf-9299-80acbc139d32 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:53:30.756086 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-27bd32c9-f689-4acf-9299-80acbc139d32 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] [instance: eb24f843-eeb3-43dd-bd48-3bcf68e344cd] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:53:30.762502 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-27bd32c9-f689-4acf-9299-80acbc139d32 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:30.763030 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-27bd32c9-f689-4acf-9299-80acbc139d32 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:30.763799 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-27bd32c9-f689-4acf-9299-80acbc139d32 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:30.764239 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-27bd32c9-f689-4acf-9299-80acbc139d32 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:30.927447 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-27bd32c9-f689-4acf-9299-80acbc139d32 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e3fd195fd14b009ba56950dc542cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620ea9c4eaa74dc5858cf93d9fcad9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:30.935465 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-27bd32c9-f689-4acf-9299-80acbc139d32 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] 10.222.0.48 "GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd" status: 200 len: 1521 microversion: 2.1 time: 0.184289 Jul 21 10:53:30.936081 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 436/882] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:53:30 2022] GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:53:31.182134 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-21b20719-ada2-4a34-bf69-6740c7539c54 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:53:31.183743 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-21b20719-ada2-4a34-bf69-6740c7539c54 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 68c9ec60-9f75-4491-a780-6c339cc6d445] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:53:31.189840 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-21b20719-ada2-4a34-bf69-6740c7539c54 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:31.190341 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-21b20719-ada2-4a34-bf69-6740c7539c54 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:31.191494 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-21b20719-ada2-4a34-bf69-6740c7539c54 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:31.191832 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-21b20719-ada2-4a34-bf69-6740c7539c54 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:31.331729 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-21b20719-ada2-4a34-bf69-6740c7539c54 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:31.340388 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-21b20719-ada2-4a34-bf69-6740c7539c54 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:31.341899 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-21b20719-ada2-4a34-bf69-6740c7539c54 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:31.343103 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-21b20719-ada2-4a34-bf69-6740c7539c54 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445" status: 200 len: 1729 microversion: 2.20 time: 0.165357 Jul 21 10:53:31.343724 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 447/883] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:53:31 2022] GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445 => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:53:31.953245 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-2cc70981-bc57-4852-b6ae-e5ef6d8342fe tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:53:31.953856 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-2cc70981-bc57-4852-b6ae-e5ef6d8342fe tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] [instance: eb24f843-eeb3-43dd-bd48-3bcf68e344cd] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:53:31.960566 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-2cc70981-bc57-4852-b6ae-e5ef6d8342fe tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:31.961017 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-2cc70981-bc57-4852-b6ae-e5ef6d8342fe tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:31.961784 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-2cc70981-bc57-4852-b6ae-e5ef6d8342fe tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:31.962223 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-2cc70981-bc57-4852-b6ae-e5ef6d8342fe tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:32.097393 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-2cc70981-bc57-4852-b6ae-e5ef6d8342fe tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e3fd195fd14b009ba56950dc542cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620ea9c4eaa74dc5858cf93d9fcad9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:32.104802 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-2cc70981-bc57-4852-b6ae-e5ef6d8342fe tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] 10.222.0.48 "GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd" status: 200 len: 1521 microversion: 2.1 time: 0.155458 Jul 21 10:53:32.105848 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 437/884] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:53:31 2022] GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:53:32.364377 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-3e59e39c-b04e-4433-8f9e-e7dac11ec4db tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:53:32.364989 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-3e59e39c-b04e-4433-8f9e-e7dac11ec4db tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 68c9ec60-9f75-4491-a780-6c339cc6d445] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:53:32.371870 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3e59e39c-b04e-4433-8f9e-e7dac11ec4db tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:32.375761 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3e59e39c-b04e-4433-8f9e-e7dac11ec4db tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:32.375761 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3e59e39c-b04e-4433-8f9e-e7dac11ec4db tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:32.375761 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3e59e39c-b04e-4433-8f9e-e7dac11ec4db tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:32.501311 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-93a34d15-0210-4e4a-a659-02f9d5fb0130 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:53:32.502606 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-93a34d15-0210-4e4a-a659-02f9d5fb0130 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 1457b868-0630-42f6-958c-da6d5bbab2ce] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:53:32.508643 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-93a34d15-0210-4e4a-a659-02f9d5fb0130 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:32.512276 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-93a34d15-0210-4e4a-a659-02f9d5fb0130 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:32.512276 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-93a34d15-0210-4e4a-a659-02f9d5fb0130 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:32.512276 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-93a34d15-0210-4e4a-a659-02f9d5fb0130 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:32.512674 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-3e59e39c-b04e-4433-8f9e-e7dac11ec4db tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:32.521263 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-3e59e39c-b04e-4433-8f9e-e7dac11ec4db tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:32.522787 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-3e59e39c-b04e-4433-8f9e-e7dac11ec4db tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:32.524050 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-3e59e39c-b04e-4433-8f9e-e7dac11ec4db tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445" status: 200 len: 1729 microversion: 2.20 time: 0.164111 Jul 21 10:53:32.524612 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 448/885] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:53:32 2022] GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445 => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:53:32.593354 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.objects.instance [None req-93a34d15-0210-4e4a-a659-02f9d5fb0130 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lazy-loading 'services' on Instance uuid 1457b868-0630-42f6-958c-da6d5bbab2ce {{(pid=124868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 10:53:32.812909 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-93a34d15-0210-4e4a-a659-02f9d5fb0130 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "DELETE /compute/v2.1/servers/1457b868-0630-42f6-958c-da6d5bbab2ce/os-volume_attachments/f7267206-ca18-4ed7-92f2-cc87916241e0" status: 202 len: 0 microversion: 2.1 time: 0.315860 Jul 21 10:53:32.814678 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 438/886] 10.222.0.48 () {58 vars in 1415 bytes} [Thu Jul 21 10:53:32 2022] DELETE /compute/v2.1/servers/1457b868-0630-42f6-958c-da6d5bbab2ce/os-volume_attachments/f7267206-ca18-4ed7-92f2-cc87916241e0 => generated 0 bytes in 319 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 21 10:53:32.824525 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-1c244440-edba-43a2-98f0-7a0611bf783b tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:53:32.837138 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-1c244440-edba-43a2-98f0-7a0611bf783b tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 1457b868-0630-42f6-958c-da6d5bbab2ce] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:53:32.837138 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1c244440-edba-43a2-98f0-7a0611bf783b tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:32.837138 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1c244440-edba-43a2-98f0-7a0611bf783b tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:32.837138 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1c244440-edba-43a2-98f0-7a0611bf783b tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:32.837579 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1c244440-edba-43a2-98f0-7a0611bf783b tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:32.864643 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [req-320faa49-9071-43ad-839e-c5b5d10426ca req-3a252359-0c43-4529-a5fd-b8a80452e63a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68c9ec60-9f75-4491-a780-6c339cc6d445", "name": "network-vif-plugged", "status": "completed", "tag": "767a932c-587b-4501-b928-eef9dd00de9e"}]} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:53:32.873712 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-320faa49-9071-43ad-839e-c5b5d10426ca req-3a252359-0c43-4529-a5fd-b8a80452e63a service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:32.874511 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-320faa49-9071-43ad-839e-c5b5d10426ca req-3a252359-0c43-4529-a5fd-b8a80452e63a service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:32.879677 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-1c244440-edba-43a2-98f0-7a0611bf783b tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/1457b868-0630-42f6-958c-da6d5bbab2ce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059751 Jul 21 10:53:32.880265 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 449/887] 10.222.0.48 () {58 vars in 1301 bytes} [Thu Jul 21 10:53:32 2022] GET /compute/v2.1/servers/1457b868-0630-42f6-958c-da6d5bbab2ce/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:53:32.890884 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.compute.server_external_events [req-320faa49-9071-43ad-839e-c5b5d10426ca req-3a252359-0c43-4529-a5fd-b8a80452e63a service nova] Creating event network-vif-plugged:767a932c-587b-4501-b928-eef9dd00de9e for instance 68c9ec60-9f75-4491-a780-6c339cc6d445 on hv-cinder-84980 Jul 21 10:53:32.896220 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [req-320faa49-9071-43ad-839e-c5b5d10426ca req-3a252359-0c43-4529-a5fd-b8a80452e63a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036098 Jul 21 10:53:32.896835 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 439/888] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 21 10:53:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:53:33.122411 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-39643be9-84fa-4a80-8605-8e49745f5b9b tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:53:33.123049 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-39643be9-84fa-4a80-8605-8e49745f5b9b tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] [instance: eb24f843-eeb3-43dd-bd48-3bcf68e344cd] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:53:33.129647 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-39643be9-84fa-4a80-8605-8e49745f5b9b tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:33.130588 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-39643be9-84fa-4a80-8605-8e49745f5b9b tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:33.131386 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-39643be9-84fa-4a80-8605-8e49745f5b9b tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:33.131814 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-39643be9-84fa-4a80-8605-8e49745f5b9b tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:33.277760 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-39643be9-84fa-4a80-8605-8e49745f5b9b tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e3fd195fd14b009ba56950dc542cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620ea9c4eaa74dc5858cf93d9fcad9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:33.285674 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-39643be9-84fa-4a80-8605-8e49745f5b9b tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] 10.222.0.48 "GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd" status: 200 len: 1521 microversion: 2.1 time: 0.167041 Jul 21 10:53:33.286251 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 450/889] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:53:33 2022] GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:53:33.542493 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-5c1c724b-9cd3-4a19-9366-9f0da8ff6044 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:53:33.543208 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-5c1c724b-9cd3-4a19-9366-9f0da8ff6044 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 68c9ec60-9f75-4491-a780-6c339cc6d445] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:53:33.549893 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5c1c724b-9cd3-4a19-9366-9f0da8ff6044 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:33.550335 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5c1c724b-9cd3-4a19-9366-9f0da8ff6044 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:33.551120 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5c1c724b-9cd3-4a19-9366-9f0da8ff6044 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:33.551554 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5c1c724b-9cd3-4a19-9366-9f0da8ff6044 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:33.685434 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-5c1c724b-9cd3-4a19-9366-9f0da8ff6044 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:33.694253 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-5c1c724b-9cd3-4a19-9366-9f0da8ff6044 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:33.695789 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-5c1c724b-9cd3-4a19-9366-9f0da8ff6044 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:33.699925 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-5c1c724b-9cd3-4a19-9366-9f0da8ff6044 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445" status: 200 len: 1729 microversion: 2.20 time: 0.159250 Jul 21 10:53:33.699925 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 440/890] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:53:33 2022] GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445 => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:53:33.891586 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-ca7795dd-f0e0-4d7c-8a0f-39fb882275cc tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:53:33.892633 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-ca7795dd-f0e0-4d7c-8a0f-39fb882275cc tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 1457b868-0630-42f6-958c-da6d5bbab2ce] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:53:33.899378 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ca7795dd-f0e0-4d7c-8a0f-39fb882275cc tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:33.899878 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ca7795dd-f0e0-4d7c-8a0f-39fb882275cc tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:33.900634 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ca7795dd-f0e0-4d7c-8a0f-39fb882275cc tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:33.901067 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ca7795dd-f0e0-4d7c-8a0f-39fb882275cc tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:33.931639 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-ca7795dd-f0e0-4d7c-8a0f-39fb882275cc tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/1457b868-0630-42f6-958c-da6d5bbab2ce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044077 Jul 21 10:53:33.932321 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 451/891] 10.222.0.48 () {58 vars in 1301 bytes} [Thu Jul 21 10:53:33 2022] GET /compute/v2.1/servers/1457b868-0630-42f6-958c-da6d5bbab2ce/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:53:34.305007 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-6b491862-f1f8-48ab-8e29-d60d6be175ce tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:53:34.305961 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-6b491862-f1f8-48ab-8e29-d60d6be175ce tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] [instance: eb24f843-eeb3-43dd-bd48-3bcf68e344cd] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:53:34.314722 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6b491862-f1f8-48ab-8e29-d60d6be175ce tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:34.315601 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6b491862-f1f8-48ab-8e29-d60d6be175ce tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:34.316664 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6b491862-f1f8-48ab-8e29-d60d6be175ce tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:34.317242 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6b491862-f1f8-48ab-8e29-d60d6be175ce tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:34.451181 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-6b491862-f1f8-48ab-8e29-d60d6be175ce tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e3fd195fd14b009ba56950dc542cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620ea9c4eaa74dc5858cf93d9fcad9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:34.458642 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-6b491862-f1f8-48ab-8e29-d60d6be175ce tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] 10.222.0.48 "GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd" status: 200 len: 1521 microversion: 2.1 time: 0.157840 Jul 21 10:53:34.459235 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 441/892] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:53:34 2022] GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:53:34.715201 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-4a28d2cf-0f4b-4d09-a2ac-f02d6171652e tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:53:34.715811 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-4a28d2cf-0f4b-4d09-a2ac-f02d6171652e tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 68c9ec60-9f75-4491-a780-6c339cc6d445] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:53:34.723280 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-4a28d2cf-0f4b-4d09-a2ac-f02d6171652e tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:34.723727 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-4a28d2cf-0f4b-4d09-a2ac-f02d6171652e tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:34.724479 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-4a28d2cf-0f4b-4d09-a2ac-f02d6171652e tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:34.724907 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-4a28d2cf-0f4b-4d09-a2ac-f02d6171652e tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:34.865042 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-4a28d2cf-0f4b-4d09-a2ac-f02d6171652e tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:34.873591 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-4a28d2cf-0f4b-4d09-a2ac-f02d6171652e tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:34.875139 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-4a28d2cf-0f4b-4d09-a2ac-f02d6171652e tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:34.876342 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-4a28d2cf-0f4b-4d09-a2ac-f02d6171652e tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445" status: 200 len: 1729 microversion: 2.20 time: 0.165493 Jul 21 10:53:34.877655 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 452/893] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:53:34 2022] GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445 => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:53:34.943821 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-5795db57-7c5b-4251-b1b1-e47957f2dfd3 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:53:34.944806 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-5795db57-7c5b-4251-b1b1-e47957f2dfd3 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 1457b868-0630-42f6-958c-da6d5bbab2ce] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:53:34.951445 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5795db57-7c5b-4251-b1b1-e47957f2dfd3 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:34.951961 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5795db57-7c5b-4251-b1b1-e47957f2dfd3 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:34.952775 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5795db57-7c5b-4251-b1b1-e47957f2dfd3 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:34.953206 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5795db57-7c5b-4251-b1b1-e47957f2dfd3 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:34.984768 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-5795db57-7c5b-4251-b1b1-e47957f2dfd3 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/1457b868-0630-42f6-958c-da6d5bbab2ce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045774 Jul 21 10:53:34.985326 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 442/894] 10.222.0.48 () {58 vars in 1301 bytes} [Thu Jul 21 10:53:34 2022] GET /compute/v2.1/servers/1457b868-0630-42f6-958c-da6d5bbab2ce/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:53:35.477399 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-dd8ee079-fc07-4254-9036-4bfe72510285 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:53:35.478021 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-dd8ee079-fc07-4254-9036-4bfe72510285 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] [instance: eb24f843-eeb3-43dd-bd48-3bcf68e344cd] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:53:35.484346 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-dd8ee079-fc07-4254-9036-4bfe72510285 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:35.484794 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-dd8ee079-fc07-4254-9036-4bfe72510285 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:35.485545 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-dd8ee079-fc07-4254-9036-4bfe72510285 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:35.485976 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-dd8ee079-fc07-4254-9036-4bfe72510285 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:35.630133 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-dd8ee079-fc07-4254-9036-4bfe72510285 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e3fd195fd14b009ba56950dc542cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620ea9c4eaa74dc5858cf93d9fcad9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:35.638197 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-dd8ee079-fc07-4254-9036-4bfe72510285 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] 10.222.0.48 "GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd" status: 200 len: 1577 microversion: 2.1 time: 0.165033 Jul 21 10:53:35.639178 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 453/895] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:53:35 2022] GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd => generated 1577 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:53:35.896965 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-e673bea5-364f-4cdf-bdcb-ad979981e63d tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:53:35.897872 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-e673bea5-364f-4cdf-bdcb-ad979981e63d tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 68c9ec60-9f75-4491-a780-6c339cc6d445] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:53:35.906377 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e673bea5-364f-4cdf-bdcb-ad979981e63d tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:35.907196 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e673bea5-364f-4cdf-bdcb-ad979981e63d tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:35.909153 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e673bea5-364f-4cdf-bdcb-ad979981e63d tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:35.909747 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e673bea5-364f-4cdf-bdcb-ad979981e63d tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:35.996855 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-3fa02378-c573-4e30-90fc-3ed28c13dc22 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:53:35.998033 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-3fa02378-c573-4e30-90fc-3ed28c13dc22 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 1457b868-0630-42f6-958c-da6d5bbab2ce] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:53:36.004684 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3fa02378-c573-4e30-90fc-3ed28c13dc22 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:36.005140 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3fa02378-c573-4e30-90fc-3ed28c13dc22 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:36.005971 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3fa02378-c573-4e30-90fc-3ed28c13dc22 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:36.006412 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3fa02378-c573-4e30-90fc-3ed28c13dc22 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:36.038161 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-3fa02378-c573-4e30-90fc-3ed28c13dc22 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/1457b868-0630-42f6-958c-da6d5bbab2ce/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045463 Jul 21 10:53:36.042590 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 454/896] 10.222.0.48 () {58 vars in 1301 bytes} [Thu Jul 21 10:53:35 2022] GET /compute/v2.1/servers/1457b868-0630-42f6-958c-da6d5bbab2ce/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 21 10:53:36.061657 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-e673bea5-364f-4cdf-bdcb-ad979981e63d tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:36.071797 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-e673bea5-364f-4cdf-bdcb-ad979981e63d tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:36.073515 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-e673bea5-364f-4cdf-bdcb-ad979981e63d tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:36.075216 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-e673bea5-364f-4cdf-bdcb-ad979981e63d tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445" status: 200 len: 1729 microversion: 2.20 time: 0.184690 Jul 21 10:53:36.076289 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 443/897] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:53:35 2022] GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445 => generated 1729 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:53:36.109864 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-8d84f027-91a3-489a-9b6a-bb760597472d tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:53:36.110362 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-8d84f027-91a3-489a-9b6a-bb760597472d tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 1457b868-0630-42f6-958c-da6d5bbab2ce] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:53:36.116725 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8d84f027-91a3-489a-9b6a-bb760597472d tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:36.117172 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8d84f027-91a3-489a-9b6a-bb760597472d tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:36.117974 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8d84f027-91a3-489a-9b6a-bb760597472d tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:36.118408 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8d84f027-91a3-489a-9b6a-bb760597472d tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:36.143801 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-8d84f027-91a3-489a-9b6a-bb760597472d tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 1457b868-0630-42f6-958c-da6d5bbab2ce] Going to try to terminate instance {{(pid=124867) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 10:53:36.417122 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-8d84f027-91a3-489a-9b6a-bb760597472d tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "DELETE /compute/v2.1/servers/1457b868-0630-42f6-958c-da6d5bbab2ce" status: 204 len: 0 microversion: 2.1 time: 0.310800 Jul 21 10:53:36.417818 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 455/898] 10.222.0.48 () {58 vars in 1238 bytes} [Thu Jul 21 10:53:36 2022] DELETE /compute/v2.1/servers/1457b868-0630-42f6-958c-da6d5bbab2ce => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 10:53:36.426864 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-dc7360af-c34e-429e-b483-63a2bab981c2 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:53:36.427476 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-dc7360af-c34e-429e-b483-63a2bab981c2 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 1457b868-0630-42f6-958c-da6d5bbab2ce] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:53:36.433439 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-dc7360af-c34e-429e-b483-63a2bab981c2 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:36.433922 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-dc7360af-c34e-429e-b483-63a2bab981c2 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:36.434698 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-dc7360af-c34e-429e-b483-63a2bab981c2 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:36.435150 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-dc7360af-c34e-429e-b483-63a2bab981c2 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:36.571612 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-dc7360af-c34e-429e-b483-63a2bab981c2 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906e4bc4e9cc45ecb01cfca7918e461d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc215aadb5345d791945658832aae4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:36.579177 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-dc7360af-c34e-429e-b483-63a2bab981c2 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/1457b868-0630-42f6-958c-da6d5bbab2ce" status: 200 len: 1682 microversion: 2.1 time: 0.156989 Jul 21 10:53:36.579798 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 444/899] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:53:36 2022] GET /compute/v2.1/servers/1457b868-0630-42f6-958c-da6d5bbab2ce => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:53:36.655827 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-aefcfa71-5e4f-405a-9bd8-a6de4ce94523 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:53:36.656565 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-aefcfa71-5e4f-405a-9bd8-a6de4ce94523 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] [instance: eb24f843-eeb3-43dd-bd48-3bcf68e344cd] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:53:36.663019 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-aefcfa71-5e4f-405a-9bd8-a6de4ce94523 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:36.663459 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-aefcfa71-5e4f-405a-9bd8-a6de4ce94523 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:36.664214 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-aefcfa71-5e4f-405a-9bd8-a6de4ce94523 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:36.664639 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-aefcfa71-5e4f-405a-9bd8-a6de4ce94523 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:36.798264 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-aefcfa71-5e4f-405a-9bd8-a6de4ce94523 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e3fd195fd14b009ba56950dc542cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620ea9c4eaa74dc5858cf93d9fcad9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:36.806680 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-aefcfa71-5e4f-405a-9bd8-a6de4ce94523 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] 10.222.0.48 "GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd" status: 200 len: 1577 microversion: 2.1 time: 0.154979 Jul 21 10:53:36.807251 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 456/900] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:53:36 2022] GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd => generated 1577 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:53:37.094515 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-3f2fc7f5-5199-48b3-af24-86b83b0d9211 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:53:37.095147 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-3f2fc7f5-5199-48b3-af24-86b83b0d9211 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 68c9ec60-9f75-4491-a780-6c339cc6d445] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:53:37.101869 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3f2fc7f5-5199-48b3-af24-86b83b0d9211 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:37.102315 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3f2fc7f5-5199-48b3-af24-86b83b0d9211 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:37.103099 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3f2fc7f5-5199-48b3-af24-86b83b0d9211 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:37.103559 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3f2fc7f5-5199-48b3-af24-86b83b0d9211 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:37.234380 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-3f2fc7f5-5199-48b3-af24-86b83b0d9211 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:37.243036 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-3f2fc7f5-5199-48b3-af24-86b83b0d9211 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:37.244551 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-3f2fc7f5-5199-48b3-af24-86b83b0d9211 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:37.245711 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-3f2fc7f5-5199-48b3-af24-86b83b0d9211 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445" status: 200 len: 1716 microversion: 2.20 time: 0.155380 Jul 21 10:53:37.246271 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 445/901] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:53:37 2022] GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445 => generated 1716 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:53:37.597660 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-ad628d05-aba0-4cab-b927-7d2ea2ff47d5 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:53:37.598267 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-ad628d05-aba0-4cab-b927-7d2ea2ff47d5 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 1457b868-0630-42f6-958c-da6d5bbab2ce] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:53:37.604816 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ad628d05-aba0-4cab-b927-7d2ea2ff47d5 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:37.604816 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ad628d05-aba0-4cab-b927-7d2ea2ff47d5 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:37.605349 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ad628d05-aba0-4cab-b927-7d2ea2ff47d5 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:37.605786 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ad628d05-aba0-4cab-b927-7d2ea2ff47d5 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:37.742853 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-ad628d05-aba0-4cab-b927-7d2ea2ff47d5 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906e4bc4e9cc45ecb01cfca7918e461d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc215aadb5345d791945658832aae4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:37.750252 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-ad628d05-aba0-4cab-b927-7d2ea2ff47d5 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/1457b868-0630-42f6-958c-da6d5bbab2ce" status: 200 len: 1682 microversion: 2.1 time: 0.156949 Jul 21 10:53:37.750845 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 457/902] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:53:37 2022] GET /compute/v2.1/servers/1457b868-0630-42f6-958c-da6d5bbab2ce => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:53:37.824991 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-0771ebaf-ec4c-4d1c-bfa5-449bdc18adc1 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:53:37.825561 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-0771ebaf-ec4c-4d1c-bfa5-449bdc18adc1 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] [instance: eb24f843-eeb3-43dd-bd48-3bcf68e344cd] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:53:37.831907 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0771ebaf-ec4c-4d1c-bfa5-449bdc18adc1 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:37.832378 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0771ebaf-ec4c-4d1c-bfa5-449bdc18adc1 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:37.833131 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0771ebaf-ec4c-4d1c-bfa5-449bdc18adc1 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:37.833564 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0771ebaf-ec4c-4d1c-bfa5-449bdc18adc1 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:37.972422 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-0771ebaf-ec4c-4d1c-bfa5-449bdc18adc1 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e3fd195fd14b009ba56950dc542cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620ea9c4eaa74dc5858cf93d9fcad9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:37.979909 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-0771ebaf-ec4c-4d1c-bfa5-449bdc18adc1 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] 10.222.0.48 "GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd" status: 200 len: 1577 microversion: 2.1 time: 0.159247 Jul 21 10:53:37.980482 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 446/903] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:53:37 2022] GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd => generated 1577 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:53:38.770827 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-91fd5d01-ea62-44e5-b6d3-4477eb399213 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:53:38.772147 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-91fd5d01-ea62-44e5-b6d3-4477eb399213 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 1457b868-0630-42f6-958c-da6d5bbab2ce] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:53:38.774592 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:53:38.780614 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-91fd5d01-ea62-44e5-b6d3-4477eb399213 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:38.784845 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-91fd5d01-ea62-44e5-b6d3-4477eb399213 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:38.784845 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-91fd5d01-ea62-44e5-b6d3-4477eb399213 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:38.784845 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-91fd5d01-ea62-44e5-b6d3-4477eb399213 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:38.852165 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-91fd5d01-ea62-44e5-b6d3-4477eb399213 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906e4bc4e9cc45ecb01cfca7918e461d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc215aadb5345d791945658832aae4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:38.859704 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-91fd5d01-ea62-44e5-b6d3-4477eb399213 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/1457b868-0630-42f6-958c-da6d5bbab2ce" status: 200 len: 1615 microversion: 2.1 time: 0.094187 Jul 21 10:53:38.860276 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 458/904] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:53:38 2022] GET /compute/v2.1/servers/1457b868-0630-42f6-958c-da6d5bbab2ce => generated 1615 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:53:38.997101 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-6a7b52b4-62f1-4752-9e64-268b878a904d tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:53:38.997712 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-6a7b52b4-62f1-4752-9e64-268b878a904d tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] [instance: eb24f843-eeb3-43dd-bd48-3bcf68e344cd] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:53:39.005103 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6a7b52b4-62f1-4752-9e64-268b878a904d tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:39.005956 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6a7b52b4-62f1-4752-9e64-268b878a904d tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:39.006934 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6a7b52b4-62f1-4752-9e64-268b878a904d tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:39.008432 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6a7b52b4-62f1-4752-9e64-268b878a904d tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:39.068438 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [req-c1867206-078a-4212-8de2-539a094e1513 req-d59d9e6a-3168-4412-973e-c6cb21b25a8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1457b868-0630-42f6-958c-da6d5bbab2ce", "name": "network-vif-deleted", "tag": "5e6868c7-2e19-4c0b-b436-ff20ce312453"}]} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:53:39.077383 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-c1867206-078a-4212-8de2-539a094e1513 req-d59d9e6a-3168-4412-973e-c6cb21b25a8d service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:39.078178 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-c1867206-078a-4212-8de2-539a094e1513 req-d59d9e6a-3168-4412-973e-c6cb21b25a8d service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:39.094588 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.compute.server_external_events [req-c1867206-078a-4212-8de2-539a094e1513 req-d59d9e6a-3168-4412-973e-c6cb21b25a8d service nova] Creating event network-vif-deleted:5e6868c7-2e19-4c0b-b436-ff20ce312453 for instance 1457b868-0630-42f6-958c-da6d5bbab2ce on hv-cinder-84980 Jul 21 10:53:39.100067 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [req-c1867206-078a-4212-8de2-539a094e1513 req-d59d9e6a-3168-4412-973e-c6cb21b25a8d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035290 Jul 21 10:53:39.101242 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 459/905] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 21 10:53:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:53:39.198374 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-6a7b52b4-62f1-4752-9e64-268b878a904d tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e3fd195fd14b009ba56950dc542cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620ea9c4eaa74dc5858cf93d9fcad9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:39.206116 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-6a7b52b4-62f1-4752-9e64-268b878a904d tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] 10.222.0.48 "GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd" status: 200 len: 1577 microversion: 2.1 time: 0.212801 Jul 21 10:53:39.206728 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 447/906] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:53:38 2022] GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd => generated 1577 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:53:39.879010 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-41f8febb-0d30-42ab-ae41-46f8020eba71 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:53:39.879728 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-41f8febb-0d30-42ab-ae41-46f8020eba71 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 1457b868-0630-42f6-958c-da6d5bbab2ce] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:53:39.886158 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-41f8febb-0d30-42ab-ae41-46f8020eba71 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:39.886628 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-41f8febb-0d30-42ab-ae41-46f8020eba71 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:39.887399 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-41f8febb-0d30-42ab-ae41-46f8020eba71 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:39.887835 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-41f8febb-0d30-42ab-ae41-46f8020eba71 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:39.904284 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:53:39.921563 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-41f8febb-0d30-42ab-ae41-46f8020eba71 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:39.922014 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-41f8febb-0d30-42ab-ae41-46f8020eba71 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:39.922471 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.objects.instance [None req-41f8febb-0d30-42ab-ae41-46f8020eba71 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lazy-loading 'fault' on Instance uuid 1457b868-0630-42f6-958c-da6d5bbab2ce {{(pid=124867) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 10:53:39.967855 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-41f8febb-0d30-42ab-ae41-46f8020eba71 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906e4bc4e9cc45ecb01cfca7918e461d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc215aadb5345d791945658832aae4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:39.975563 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-41f8febb-0d30-42ab-ae41-46f8020eba71 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/1457b868-0630-42f6-958c-da6d5bbab2ce" status: 200 len: 1332 microversion: 2.1 time: 0.101982 Jul 21 10:53:39.976144 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 460/907] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:53:39 2022] GET /compute/v2.1/servers/1457b868-0630-42f6-958c-da6d5bbab2ce => generated 1332 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:53:40.224338 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-dfcdb67b-3c63-4dfe-a96d-9a9f76c66f95 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:53:40.225090 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-dfcdb67b-3c63-4dfe-a96d-9a9f76c66f95 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] [instance: eb24f843-eeb3-43dd-bd48-3bcf68e344cd] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:53:40.231666 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-dfcdb67b-3c63-4dfe-a96d-9a9f76c66f95 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:40.232296 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-dfcdb67b-3c63-4dfe-a96d-9a9f76c66f95 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:40.233308 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-dfcdb67b-3c63-4dfe-a96d-9a9f76c66f95 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:40.234223 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-dfcdb67b-3c63-4dfe-a96d-9a9f76c66f95 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:40.375949 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-dfcdb67b-3c63-4dfe-a96d-9a9f76c66f95 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e3fd195fd14b009ba56950dc542cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620ea9c4eaa74dc5858cf93d9fcad9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:40.379432 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:53:40.383722 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-dfcdb67b-3c63-4dfe-a96d-9a9f76c66f95 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] 10.222.0.48 "GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd" status: 200 len: 1577 microversion: 2.1 time: 0.163570 Jul 21 10:53:40.385006 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 448/908] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:53:40 2022] GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd => generated 1577 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:53:40.993641 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-da4d4d65-aef7-4381-ab43-711503d6a6e0 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:53:40.994261 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-da4d4d65-aef7-4381-ab43-711503d6a6e0 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 1457b868-0630-42f6-958c-da6d5bbab2ce] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:53:41.000977 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-da4d4d65-aef7-4381-ab43-711503d6a6e0 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:41.001416 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-da4d4d65-aef7-4381-ab43-711503d6a6e0 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:41.002820 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-da4d4d65-aef7-4381-ab43-711503d6a6e0 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:41.003232 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-da4d4d65-aef7-4381-ab43-711503d6a6e0 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:41.016025 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.wsgi [None req-da4d4d65-aef7-4381-ab43-711503d6a6e0 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] HTTP exception thrown: Instance 1457b868-0630-42f6-958c-da6d5bbab2ce could not be found. Jul 21 10:53:41.017668 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-da4d4d65-aef7-4381-ab43-711503d6a6e0 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Request method failure captured: Jul 21 10:53:41.017668 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: request: GET /compute/v2.1/servers/1457b868-0630-42f6-958c-da6d5bbab2ce HTTP/1.1 Jul 21 10:53:41.017668 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Accept: application/json Jul 21 10:53:41.017668 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Accept-Encoding: identity Jul 21 10:53:41.017668 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Connection: close Jul 21 10:53:41.017668 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Content-Length: 0 Jul 21 10:53:41.017668 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Content-Type: application/json Jul 21 10:53:41.017668 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Host: 10.222.0.48 Jul 21 10:53:41.017668 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Openstack-System-Scope: None Jul 21 10:53:41.017668 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: User-Agent: python-urllib3/1.26.9 Jul 21 10:53:41.017668 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Auth-Token: gAAAAABi2S6IjD13fpvyB3gT_wfBhrxBWJW9IyP2Nfh-tKREma2qJlItcJifOI1FikOPoU86kC4jMPIUJv7c1XQEgHyn13RPV4dm8YXLpWP83NoB7MDue-0ef8jz1-9ETLoC72jgbX7x_bNoV_fia9kSfgVPDrqxya-pNvknwmV6TjdQwJPLki8 Jul 21 10:53:41.017668 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Domain-Id: None Jul 21 10:53:41.017668 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Domain-Name: None Jul 21 10:53:41.017668 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Identity-Status: Confirmed Jul 21 10:53:41.017668 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Is-Admin-Project: True Jul 21 10:53:41.017668 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Project-Domain-Id: default Jul 21 10:53:41.017668 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Project-Domain-Name: Default Jul 21 10:53:41.017668 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Project-Id: 0dc215aadb5345d791945658832aae4a Jul 21 10:53:41.017668 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Project-Name: tempest-AttachVolumeNegativeTest-692763952 Jul 21 10:53:41.017668 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Role: reader,member Jul 21 10:53:41.017668 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Roles: reader,member Jul 21 10:53:41.019285 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0dc215aadb5345d791945658832aae4a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0dc215aadb5345d791945658832aae4a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0dc215aadb5345d791945658832aae4a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0dc215aadb5345d791945658832aae4a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] Jul 21 10:53:41.019285 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Tenant: tempest-AttachVolumeNegativeTest-692763952 Jul 21 10:53:41.019285 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Tenant-Id: 0dc215aadb5345d791945658832aae4a Jul 21 10:53:41.019285 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-692763952 Jul 21 10:53:41.019285 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User: tempest-AttachVolumeNegativeTest-692763952-project Jul 21 10:53:41.019285 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User-Domain-Id: default Jul 21 10:53:41.019285 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User-Domain-Name: Default Jul 21 10:53:41.019285 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User-Id: 906e4bc4e9cc45ecb01cfca7918e461d Jul 21 10:53:41.019285 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User-Name: tempest-AttachVolumeNegativeTest-692763952-project Jul 21 10:53:41.019285 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: method: > Jul 21 10:53:41.019285 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: exception: Instance 1457b868-0630-42f6-958c-da6d5bbab2ce could not be found. Jul 21 10:53:41.019285 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: action_args: {'id': '1457b868-0630-42f6-958c-da6d5bbab2ce'} Jul 21 10:53:41.020527 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 10:53:41.020527 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:53:41.020527 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 10:53:41.020527 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 10:53:41.020527 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 10:53:41.020527 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 10:53:41.020527 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 10:53:41.020527 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 10:53:41.020527 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 10:53:41.020527 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 10:53:41.020527 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1457b868-0630-42f6-958c-da6d5bbab2ce could not be found. Jul 21 10:53:41.020527 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:53:41.020527 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:53:41.020527 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:53:41.020527 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:53:41.020527 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:53:41.020527 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:53:41.020527 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 10:53:41.020527 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 10:53:41.020527 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 10:53:41.022086 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 10:53:41.022086 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 10:53:41.022086 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 10:53:41.022086 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 10:53:41.022086 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 10:53:41.022086 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 10:53:41.022086 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 10:53:41.022086 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1457b868-0630-42f6-958c-da6d5bbab2ce could not be found. Jul 21 10:53:41.022086 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:53:41.022086 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:53:41.022086 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:53:41.022086 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:53:41.022086 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:53:41.022086 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:53:41.022086 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 10:53:41.022086 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 10:53:41.022086 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1457b868-0630-42f6-958c-da6d5bbab2ce could not be found. Jul 21 10:53:41.022086 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:53:41.023587 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-da4d4d65-aef7-4381-ab43-711503d6a6e0 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Returning 404 to user: Instance 1457b868-0630-42f6-958c-da6d5bbab2ce could not be found. {{(pid=124867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 10:53:41.023587 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-da4d4d65-aef7-4381-ab43-711503d6a6e0 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/1457b868-0630-42f6-958c-da6d5bbab2ce" status: 404 len: 111 microversion: 2.1 time: 0.029694 Jul 21 10:53:41.023587 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 461/909] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:53:40 2022] GET /compute/v2.1/servers/1457b868-0630-42f6-958c-da6d5bbab2ce => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 10:53:41.027865 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-f6a6464e-224e-48aa-8a1e-00ce65bed0a2 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '.version_select at 0x7f79629c6ee0>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:53:41.143084 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-f6a6464e-224e-48aa-8a1e-00ce65bed0a2 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1042340688" status: 202 len: 0 microversion: 2.1 time: 0.119009 Jul 21 10:53:41.143674 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 449/910] 10.222.0.48 () {58 vars in 1220 bytes} [Thu Jul 21 10:53:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1042340688 => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 10:53:41.403735 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-ce1f0284-6a98-4340-a474-eeae98c007dd tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:53:41.405067 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-ce1f0284-6a98-4340-a474-eeae98c007dd tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] [instance: eb24f843-eeb3-43dd-bd48-3bcf68e344cd] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:53:41.412472 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ce1f0284-6a98-4340-a474-eeae98c007dd tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:41.412912 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ce1f0284-6a98-4340-a474-eeae98c007dd tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:41.414017 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ce1f0284-6a98-4340-a474-eeae98c007dd tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:41.414663 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ce1f0284-6a98-4340-a474-eeae98c007dd tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:41.556265 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-ce1f0284-6a98-4340-a474-eeae98c007dd tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e3fd195fd14b009ba56950dc542cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620ea9c4eaa74dc5858cf93d9fcad9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:41.560945 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-ce1f0284-6a98-4340-a474-eeae98c007dd tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] 10.222.0.48 "GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd" status: 200 len: 1577 microversion: 2.1 time: 0.162713 Jul 21 10:53:41.570965 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 462/911] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:53:41 2022] GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd => generated 1577 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:53:42.579076 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-46b62863-90f2-4284-8957-5c687301e230 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:53:42.579775 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-46b62863-90f2-4284-8957-5c687301e230 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] [instance: eb24f843-eeb3-43dd-bd48-3bcf68e344cd] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:53:42.587471 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-46b62863-90f2-4284-8957-5c687301e230 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:42.588285 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-46b62863-90f2-4284-8957-5c687301e230 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:42.589039 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-46b62863-90f2-4284-8957-5c687301e230 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:42.589531 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-46b62863-90f2-4284-8957-5c687301e230 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:42.734995 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-46b62863-90f2-4284-8957-5c687301e230 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e3fd195fd14b009ba56950dc542cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620ea9c4eaa74dc5858cf93d9fcad9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:42.744302 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-46b62863-90f2-4284-8957-5c687301e230 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] 10.222.0.48 "GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd" status: 200 len: 1577 microversion: 2.1 time: 0.169607 Jul 21 10:53:42.745034 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 450/912] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:53:42 2022] GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd => generated 1577 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:53:43.191594 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-bab6b987-3526-46c5-94da-7fb1b6d85311 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:53:43.193319 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-bab6b987-3526-46c5-94da-7fb1b6d85311 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 1457b868-0630-42f6-958c-da6d5bbab2ce] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:53:43.201080 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-bab6b987-3526-46c5-94da-7fb1b6d85311 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:43.201689 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-bab6b987-3526-46c5-94da-7fb1b6d85311 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:43.202846 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-bab6b987-3526-46c5-94da-7fb1b6d85311 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:43.212315 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-bab6b987-3526-46c5-94da-7fb1b6d85311 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:43.234332 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.wsgi [None req-bab6b987-3526-46c5-94da-7fb1b6d85311 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] HTTP exception thrown: Instance 1457b868-0630-42f6-958c-da6d5bbab2ce could not be found. Jul 21 10:53:43.235920 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-bab6b987-3526-46c5-94da-7fb1b6d85311 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Request method failure captured: Jul 21 10:53:43.235920 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: request: DELETE /compute/v2.1/servers/1457b868-0630-42f6-958c-da6d5bbab2ce HTTP/1.1 Jul 21 10:53:43.235920 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Accept: application/json Jul 21 10:53:43.235920 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Accept-Encoding: identity Jul 21 10:53:43.235920 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Connection: close Jul 21 10:53:43.235920 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Content-Length: 0 Jul 21 10:53:43.235920 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Content-Type: application/json Jul 21 10:53:43.235920 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Host: 10.222.0.48 Jul 21 10:53:43.235920 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Openstack-System-Scope: None Jul 21 10:53:43.235920 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: User-Agent: python-urllib3/1.26.9 Jul 21 10:53:43.235920 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Auth-Token: gAAAAABi2S6IjD13fpvyB3gT_wfBhrxBWJW9IyP2Nfh-tKREma2qJlItcJifOI1FikOPoU86kC4jMPIUJv7c1XQEgHyn13RPV4dm8YXLpWP83NoB7MDue-0ef8jz1-9ETLoC72jgbX7x_bNoV_fia9kSfgVPDrqxya-pNvknwmV6TjdQwJPLki8 Jul 21 10:53:43.235920 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Domain-Id: None Jul 21 10:53:43.235920 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Domain-Name: None Jul 21 10:53:43.235920 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Identity-Status: Confirmed Jul 21 10:53:43.235920 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Is-Admin-Project: True Jul 21 10:53:43.235920 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Project-Domain-Id: default Jul 21 10:53:43.235920 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Project-Domain-Name: Default Jul 21 10:53:43.235920 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Project-Id: 0dc215aadb5345d791945658832aae4a Jul 21 10:53:43.235920 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Project-Name: tempest-AttachVolumeNegativeTest-692763952 Jul 21 10:53:43.235920 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Role: reader,member Jul 21 10:53:43.235920 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Roles: reader,member Jul 21 10:53:43.238222 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0dc215aadb5345d791945658832aae4a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0dc215aadb5345d791945658832aae4a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0dc215aadb5345d791945658832aae4a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0dc215aadb5345d791945658832aae4a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] Jul 21 10:53:43.238222 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Tenant: tempest-AttachVolumeNegativeTest-692763952 Jul 21 10:53:43.238222 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Tenant-Id: 0dc215aadb5345d791945658832aae4a Jul 21 10:53:43.238222 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-692763952 Jul 21 10:53:43.238222 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User: tempest-AttachVolumeNegativeTest-692763952-project Jul 21 10:53:43.238222 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User-Domain-Id: default Jul 21 10:53:43.238222 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User-Domain-Name: Default Jul 21 10:53:43.238222 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User-Id: 906e4bc4e9cc45ecb01cfca7918e461d Jul 21 10:53:43.238222 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User-Name: tempest-AttachVolumeNegativeTest-692763952-project Jul 21 10:53:43.238222 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: method: > Jul 21 10:53:43.238222 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: exception: Instance 1457b868-0630-42f6-958c-da6d5bbab2ce could not be found. Jul 21 10:53:43.238222 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: action_args: {'id': '1457b868-0630-42f6-958c-da6d5bbab2ce'} Jul 21 10:53:43.238986 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 10:53:43.238986 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:53:43.238986 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 10:53:43.238986 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 10:53:43.238986 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 10:53:43.238986 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 10:53:43.238986 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 10:53:43.238986 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 10:53:43.238986 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 10:53:43.238986 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 10:53:43.238986 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1457b868-0630-42f6-958c-da6d5bbab2ce could not be found. Jul 21 10:53:43.238986 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:53:43.238986 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:53:43.238986 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:53:43.238986 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:53:43.238986 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:53:43.238986 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:53:43.238986 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 10:53:43.238986 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 10:53:43.238986 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 10:53:43.240401 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 10:53:43.240401 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 21 10:53:43.240401 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 21 10:53:43.240401 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 21 10:53:43.240401 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 21 10:53:43.240401 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 10:53:43.240401 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 10:53:43.240401 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 10:53:43.240401 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 10:53:43.240401 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1457b868-0630-42f6-958c-da6d5bbab2ce could not be found. Jul 21 10:53:43.240401 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:53:43.240401 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:53:43.240401 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:53:43.240401 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:53:43.240401 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:53:43.240401 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:53:43.240401 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 10:53:43.240401 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 10:53:43.240401 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1457b868-0630-42f6-958c-da6d5bbab2ce could not be found. Jul 21 10:53:43.240401 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:53:43.242501 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-bab6b987-3526-46c5-94da-7fb1b6d85311 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Returning 404 to user: Instance 1457b868-0630-42f6-958c-da6d5bbab2ce could not be found. {{(pid=124867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 10:53:43.242501 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-bab6b987-3526-46c5-94da-7fb1b6d85311 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "DELETE /compute/v2.1/servers/1457b868-0630-42f6-958c-da6d5bbab2ce" status: 404 len: 111 microversion: 2.1 time: 0.050993 Jul 21 10:53:43.242501 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 463/913] 10.222.0.48 () {58 vars in 1238 bytes} [Thu Jul 21 10:53:43 2022] DELETE /compute/v2.1/servers/1457b868-0630-42f6-958c-da6d5bbab2ce => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 10:53:43.246480 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-ab201766-b6cb-40a7-bc03-838d43e49033 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:53:43.247157 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-ab201766-b6cb-40a7-bc03-838d43e49033 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 1457b868-0630-42f6-958c-da6d5bbab2ce] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:53:43.254801 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ab201766-b6cb-40a7-bc03-838d43e49033 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:43.255556 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ab201766-b6cb-40a7-bc03-838d43e49033 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:43.256554 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ab201766-b6cb-40a7-bc03-838d43e49033 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:43.257047 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ab201766-b6cb-40a7-bc03-838d43e49033 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:43.274781 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.wsgi [None req-ab201766-b6cb-40a7-bc03-838d43e49033 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] HTTP exception thrown: Instance 1457b868-0630-42f6-958c-da6d5bbab2ce could not be found. Jul 21 10:53:43.276785 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-ab201766-b6cb-40a7-bc03-838d43e49033 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Request method failure captured: Jul 21 10:53:43.276785 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: request: GET /compute/v2.1/servers/1457b868-0630-42f6-958c-da6d5bbab2ce HTTP/1.1 Jul 21 10:53:43.276785 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Accept: application/json Jul 21 10:53:43.276785 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Accept-Encoding: identity Jul 21 10:53:43.276785 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Connection: close Jul 21 10:53:43.276785 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Content-Length: 0 Jul 21 10:53:43.276785 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Content-Type: application/json Jul 21 10:53:43.276785 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Host: 10.222.0.48 Jul 21 10:53:43.276785 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Openstack-System-Scope: None Jul 21 10:53:43.276785 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: User-Agent: python-urllib3/1.26.9 Jul 21 10:53:43.276785 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Auth-Token: gAAAAABi2S6IjD13fpvyB3gT_wfBhrxBWJW9IyP2Nfh-tKREma2qJlItcJifOI1FikOPoU86kC4jMPIUJv7c1XQEgHyn13RPV4dm8YXLpWP83NoB7MDue-0ef8jz1-9ETLoC72jgbX7x_bNoV_fia9kSfgVPDrqxya-pNvknwmV6TjdQwJPLki8 Jul 21 10:53:43.276785 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Domain-Id: None Jul 21 10:53:43.276785 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Domain-Name: None Jul 21 10:53:43.276785 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Identity-Status: Confirmed Jul 21 10:53:43.276785 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Is-Admin-Project: True Jul 21 10:53:43.276785 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Domain-Id: default Jul 21 10:53:43.276785 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Domain-Name: Default Jul 21 10:53:43.276785 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Id: 0dc215aadb5345d791945658832aae4a Jul 21 10:53:43.276785 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Name: tempest-AttachVolumeNegativeTest-692763952 Jul 21 10:53:43.276785 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Role: reader,member Jul 21 10:53:43.276785 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Roles: reader,member Jul 21 10:53:43.278345 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0dc215aadb5345d791945658832aae4a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0dc215aadb5345d791945658832aae4a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0dc215aadb5345d791945658832aae4a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0dc215aadb5345d791945658832aae4a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] Jul 21 10:53:43.278345 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Tenant: tempest-AttachVolumeNegativeTest-692763952 Jul 21 10:53:43.278345 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Tenant-Id: 0dc215aadb5345d791945658832aae4a Jul 21 10:53:43.278345 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-692763952 Jul 21 10:53:43.278345 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User: tempest-AttachVolumeNegativeTest-692763952-project Jul 21 10:53:43.278345 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Domain-Id: default Jul 21 10:53:43.278345 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Domain-Name: Default Jul 21 10:53:43.278345 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Id: 906e4bc4e9cc45ecb01cfca7918e461d Jul 21 10:53:43.278345 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Name: tempest-AttachVolumeNegativeTest-692763952-project Jul 21 10:53:43.278345 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: method: > Jul 21 10:53:43.278345 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: exception: Instance 1457b868-0630-42f6-958c-da6d5bbab2ce could not be found. Jul 21 10:53:43.278345 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: action_args: {'id': '1457b868-0630-42f6-958c-da6d5bbab2ce'} Jul 21 10:53:43.279207 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 10:53:43.279207 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:53:43.279207 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 10:53:43.279207 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 10:53:43.279207 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 10:53:43.279207 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 10:53:43.279207 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 10:53:43.279207 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 10:53:43.279207 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 10:53:43.279207 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 10:53:43.279207 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1457b868-0630-42f6-958c-da6d5bbab2ce could not be found. Jul 21 10:53:43.279207 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:53:43.279207 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:53:43.279207 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:53:43.279207 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:53:43.279207 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:53:43.279207 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:53:43.279207 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 10:53:43.279207 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 10:53:43.279207 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 10:53:43.280717 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 10:53:43.280717 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 10:53:43.280717 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 10:53:43.280717 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 10:53:43.280717 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 10:53:43.280717 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 10:53:43.280717 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 10:53:43.280717 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1457b868-0630-42f6-958c-da6d5bbab2ce could not be found. Jul 21 10:53:43.280717 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:53:43.280717 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:53:43.280717 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:53:43.280717 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:53:43.280717 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:53:43.280717 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:53:43.280717 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 10:53:43.280717 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 10:53:43.280717 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1457b868-0630-42f6-958c-da6d5bbab2ce could not be found. Jul 21 10:53:43.280717 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:53:43.282006 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-ab201766-b6cb-40a7-bc03-838d43e49033 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Returning 404 to user: Instance 1457b868-0630-42f6-958c-da6d5bbab2ce could not be found. {{(pid=124868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 10:53:43.282006 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-ab201766-b6cb-40a7-bc03-838d43e49033 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/1457b868-0630-42f6-958c-da6d5bbab2ce" status: 404 len: 111 microversion: 2.1 time: 0.035445 Jul 21 10:53:43.282006 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 451/914] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:53:43 2022] GET /compute/v2.1/servers/1457b868-0630-42f6-958c-da6d5bbab2ce => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 10:53:43.763308 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-d8f3ef7c-5101-46a5-b7b8-c2c36b45c4c7 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:53:43.763914 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-d8f3ef7c-5101-46a5-b7b8-c2c36b45c4c7 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] [instance: eb24f843-eeb3-43dd-bd48-3bcf68e344cd] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:53:43.771328 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d8f3ef7c-5101-46a5-b7b8-c2c36b45c4c7 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:43.771772 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d8f3ef7c-5101-46a5-b7b8-c2c36b45c4c7 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:43.772611 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d8f3ef7c-5101-46a5-b7b8-c2c36b45c4c7 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:43.772965 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d8f3ef7c-5101-46a5-b7b8-c2c36b45c4c7 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:43.936995 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-d8f3ef7c-5101-46a5-b7b8-c2c36b45c4c7 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e3fd195fd14b009ba56950dc542cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620ea9c4eaa74dc5858cf93d9fcad9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:43.944881 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-d8f3ef7c-5101-46a5-b7b8-c2c36b45c4c7 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] 10.222.0.48 "GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd" status: 200 len: 1577 microversion: 2.1 time: 0.185661 Jul 21 10:53:43.945451 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 464/915] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:53:43 2022] GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd => generated 1577 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:53:44.567793 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-bd225fcd-2957-451e-aa67-5d148ccfb17e tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:53:44.568296 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-bd225fcd-2957-451e-aa67-5d148ccfb17e tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 6803db4b-7556-4e4e-989c-adfa3d140a09] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:53:44.575354 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-bd225fcd-2957-451e-aa67-5d148ccfb17e tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:44.575810 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-bd225fcd-2957-451e-aa67-5d148ccfb17e tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:44.576584 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-bd225fcd-2957-451e-aa67-5d148ccfb17e tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:44.577024 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-bd225fcd-2957-451e-aa67-5d148ccfb17e tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:44.591784 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.wsgi [None req-bd225fcd-2957-451e-aa67-5d148ccfb17e tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] HTTP exception thrown: Instance 6803db4b-7556-4e4e-989c-adfa3d140a09 could not be found. Jul 21 10:53:44.593348 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-bd225fcd-2957-451e-aa67-5d148ccfb17e tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Request method failure captured: Jul 21 10:53:44.593348 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: request: DELETE /compute/v2.1/servers/6803db4b-7556-4e4e-989c-adfa3d140a09 HTTP/1.1 Jul 21 10:53:44.593348 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Accept: application/json Jul 21 10:53:44.593348 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Accept-Encoding: identity Jul 21 10:53:44.593348 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Connection: close Jul 21 10:53:44.593348 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Content-Length: 0 Jul 21 10:53:44.593348 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Content-Type: application/json Jul 21 10:53:44.593348 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Host: 10.222.0.48 Jul 21 10:53:44.593348 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Openstack-System-Scope: None Jul 21 10:53:44.593348 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: User-Agent: python-urllib3/1.26.9 Jul 21 10:53:44.593348 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Auth-Token: gAAAAABi2S6IjD13fpvyB3gT_wfBhrxBWJW9IyP2Nfh-tKREma2qJlItcJifOI1FikOPoU86kC4jMPIUJv7c1XQEgHyn13RPV4dm8YXLpWP83NoB7MDue-0ef8jz1-9ETLoC72jgbX7x_bNoV_fia9kSfgVPDrqxya-pNvknwmV6TjdQwJPLki8 Jul 21 10:53:44.593348 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Domain-Id: None Jul 21 10:53:44.593348 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Domain-Name: None Jul 21 10:53:44.593348 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Identity-Status: Confirmed Jul 21 10:53:44.593348 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Is-Admin-Project: True Jul 21 10:53:44.593348 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Domain-Id: default Jul 21 10:53:44.593348 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Domain-Name: Default Jul 21 10:53:44.593348 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Id: 0dc215aadb5345d791945658832aae4a Jul 21 10:53:44.593348 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Name: tempest-AttachVolumeNegativeTest-692763952 Jul 21 10:53:44.593348 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Role: reader,member Jul 21 10:53:44.593348 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Roles: reader,member Jul 21 10:53:44.594801 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0dc215aadb5345d791945658832aae4a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0dc215aadb5345d791945658832aae4a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0dc215aadb5345d791945658832aae4a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0dc215aadb5345d791945658832aae4a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] Jul 21 10:53:44.594801 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Tenant: tempest-AttachVolumeNegativeTest-692763952 Jul 21 10:53:44.594801 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Tenant-Id: 0dc215aadb5345d791945658832aae4a Jul 21 10:53:44.594801 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-692763952 Jul 21 10:53:44.594801 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User: tempest-AttachVolumeNegativeTest-692763952-project Jul 21 10:53:44.594801 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Domain-Id: default Jul 21 10:53:44.594801 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Domain-Name: Default Jul 21 10:53:44.594801 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Id: 906e4bc4e9cc45ecb01cfca7918e461d Jul 21 10:53:44.594801 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Name: tempest-AttachVolumeNegativeTest-692763952-project Jul 21 10:53:44.594801 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: method: > Jul 21 10:53:44.594801 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: exception: Instance 6803db4b-7556-4e4e-989c-adfa3d140a09 could not be found. Jul 21 10:53:44.594801 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: action_args: {'id': '6803db4b-7556-4e4e-989c-adfa3d140a09'} Jul 21 10:53:44.595655 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 10:53:44.595655 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:53:44.595655 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 10:53:44.595655 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 10:53:44.595655 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 10:53:44.595655 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 10:53:44.595655 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 10:53:44.595655 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 10:53:44.595655 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 10:53:44.595655 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 10:53:44.595655 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6803db4b-7556-4e4e-989c-adfa3d140a09 could not be found. Jul 21 10:53:44.595655 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:53:44.595655 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:53:44.595655 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:53:44.595655 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:53:44.595655 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:53:44.595655 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:53:44.595655 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 10:53:44.595655 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 10:53:44.595655 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 10:53:44.597108 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 10:53:44.597108 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 21 10:53:44.597108 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 21 10:53:44.597108 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 21 10:53:44.597108 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 21 10:53:44.597108 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 10:53:44.597108 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 10:53:44.597108 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 10:53:44.597108 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 10:53:44.597108 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6803db4b-7556-4e4e-989c-adfa3d140a09 could not be found. Jul 21 10:53:44.597108 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:53:44.597108 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:53:44.597108 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:53:44.597108 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:53:44.597108 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:53:44.597108 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:53:44.597108 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 10:53:44.597108 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 10:53:44.597108 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6803db4b-7556-4e4e-989c-adfa3d140a09 could not be found. Jul 21 10:53:44.597108 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:53:44.598507 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-bd225fcd-2957-451e-aa67-5d148ccfb17e tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Returning 404 to user: Instance 6803db4b-7556-4e4e-989c-adfa3d140a09 could not be found. {{(pid=124868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 10:53:44.598507 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-bd225fcd-2957-451e-aa67-5d148ccfb17e tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "DELETE /compute/v2.1/servers/6803db4b-7556-4e4e-989c-adfa3d140a09" status: 404 len: 111 microversion: 2.1 time: 0.031994 Jul 21 10:53:44.598507 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 452/916] 10.222.0.48 () {58 vars in 1238 bytes} [Thu Jul 21 10:53:44 2022] DELETE /compute/v2.1/servers/6803db4b-7556-4e4e-989c-adfa3d140a09 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 10:53:44.603793 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-ac2b3aee-1d94-474c-b67c-7f0fa0a5c122 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:53:44.604407 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-ac2b3aee-1d94-474c-b67c-7f0fa0a5c122 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 6803db4b-7556-4e4e-989c-adfa3d140a09] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:53:44.611342 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ac2b3aee-1d94-474c-b67c-7f0fa0a5c122 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:44.611796 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ac2b3aee-1d94-474c-b67c-7f0fa0a5c122 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:44.612760 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ac2b3aee-1d94-474c-b67c-7f0fa0a5c122 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:44.613199 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ac2b3aee-1d94-474c-b67c-7f0fa0a5c122 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:44.630921 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.wsgi [None req-ac2b3aee-1d94-474c-b67c-7f0fa0a5c122 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] HTTP exception thrown: Instance 6803db4b-7556-4e4e-989c-adfa3d140a09 could not be found. Jul 21 10:53:44.632866 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-ac2b3aee-1d94-474c-b67c-7f0fa0a5c122 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Request method failure captured: Jul 21 10:53:44.632866 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: request: GET /compute/v2.1/servers/6803db4b-7556-4e4e-989c-adfa3d140a09 HTTP/1.1 Jul 21 10:53:44.632866 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Accept: application/json Jul 21 10:53:44.632866 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Accept-Encoding: identity Jul 21 10:53:44.632866 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Connection: close Jul 21 10:53:44.632866 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Content-Length: 0 Jul 21 10:53:44.632866 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Content-Type: application/json Jul 21 10:53:44.632866 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Host: 10.222.0.48 Jul 21 10:53:44.632866 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Openstack-System-Scope: None Jul 21 10:53:44.632866 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: User-Agent: python-urllib3/1.26.9 Jul 21 10:53:44.632866 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Auth-Token: gAAAAABi2S6IjD13fpvyB3gT_wfBhrxBWJW9IyP2Nfh-tKREma2qJlItcJifOI1FikOPoU86kC4jMPIUJv7c1XQEgHyn13RPV4dm8YXLpWP83NoB7MDue-0ef8jz1-9ETLoC72jgbX7x_bNoV_fia9kSfgVPDrqxya-pNvknwmV6TjdQwJPLki8 Jul 21 10:53:44.632866 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Domain-Id: None Jul 21 10:53:44.632866 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Domain-Name: None Jul 21 10:53:44.632866 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Identity-Status: Confirmed Jul 21 10:53:44.632866 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Is-Admin-Project: True Jul 21 10:53:44.632866 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Project-Domain-Id: default Jul 21 10:53:44.632866 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Project-Domain-Name: Default Jul 21 10:53:44.632866 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Project-Id: 0dc215aadb5345d791945658832aae4a Jul 21 10:53:44.632866 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Project-Name: tempest-AttachVolumeNegativeTest-692763952 Jul 21 10:53:44.632866 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Role: reader,member Jul 21 10:53:44.632866 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Roles: reader,member Jul 21 10:53:44.634349 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0dc215aadb5345d791945658832aae4a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0dc215aadb5345d791945658832aae4a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0dc215aadb5345d791945658832aae4a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0dc215aadb5345d791945658832aae4a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] Jul 21 10:53:44.634349 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Tenant: tempest-AttachVolumeNegativeTest-692763952 Jul 21 10:53:44.634349 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Tenant-Id: 0dc215aadb5345d791945658832aae4a Jul 21 10:53:44.634349 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-692763952 Jul 21 10:53:44.634349 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User: tempest-AttachVolumeNegativeTest-692763952-project Jul 21 10:53:44.634349 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User-Domain-Id: default Jul 21 10:53:44.634349 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User-Domain-Name: Default Jul 21 10:53:44.634349 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User-Id: 906e4bc4e9cc45ecb01cfca7918e461d Jul 21 10:53:44.634349 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User-Name: tempest-AttachVolumeNegativeTest-692763952-project Jul 21 10:53:44.634349 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: method: > Jul 21 10:53:44.634349 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: exception: Instance 6803db4b-7556-4e4e-989c-adfa3d140a09 could not be found. Jul 21 10:53:44.634349 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: action_args: {'id': '6803db4b-7556-4e4e-989c-adfa3d140a09'} Jul 21 10:53:44.635199 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 10:53:44.635199 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:53:44.635199 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 10:53:44.635199 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 10:53:44.635199 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 10:53:44.635199 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 10:53:44.635199 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 10:53:44.635199 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 10:53:44.635199 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 10:53:44.635199 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 10:53:44.635199 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6803db4b-7556-4e4e-989c-adfa3d140a09 could not be found. Jul 21 10:53:44.635199 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:53:44.635199 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:53:44.635199 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:53:44.635199 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:53:44.635199 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:53:44.635199 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:53:44.635199 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 10:53:44.635199 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 10:53:44.635199 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 10:53:44.636633 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 10:53:44.636633 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 10:53:44.636633 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 10:53:44.636633 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 10:53:44.636633 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 10:53:44.636633 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 10:53:44.636633 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 10:53:44.636633 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6803db4b-7556-4e4e-989c-adfa3d140a09 could not be found. Jul 21 10:53:44.636633 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:53:44.636633 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:53:44.636633 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:53:44.636633 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:53:44.636633 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:53:44.636633 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:53:44.636633 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 10:53:44.636633 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 10:53:44.636633 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6803db4b-7556-4e4e-989c-adfa3d140a09 could not be found. Jul 21 10:53:44.636633 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:53:44.638844 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-ac2b3aee-1d94-474c-b67c-7f0fa0a5c122 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Returning 404 to user: Instance 6803db4b-7556-4e4e-989c-adfa3d140a09 could not be found. {{(pid=124867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 10:53:44.639961 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-ac2b3aee-1d94-474c-b67c-7f0fa0a5c122 tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/6803db4b-7556-4e4e-989c-adfa3d140a09" status: 404 len: 111 microversion: 2.1 time: 0.039933 Jul 21 10:53:44.640522 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 465/917] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:53:44 2022] GET /compute/v2.1/servers/6803db4b-7556-4e4e-989c-adfa3d140a09 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 10:53:44.650070 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-52671619-956b-454b-9acb-9abc7c18258c tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:53:44.650584 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-52671619-956b-454b-9acb-9abc7c18258c tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:53:44.656852 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-52671619-956b-454b-9acb-9abc7c18258c tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:44.657300 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-52671619-956b-454b-9acb-9abc7c18258c tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:44.658235 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-52671619-956b-454b-9acb-9abc7c18258c tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:44.658844 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-52671619-956b-454b-9acb-9abc7c18258c tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:44.675020 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.wsgi [None req-52671619-956b-454b-9acb-9abc7c18258c tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] HTTP exception thrown: Instance 73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b could not be found. Jul 21 10:53:44.676736 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-52671619-956b-454b-9acb-9abc7c18258c tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Request method failure captured: Jul 21 10:53:44.676736 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: request: DELETE /compute/v2.1/servers/73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b HTTP/1.1 Jul 21 10:53:44.676736 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Accept: application/json Jul 21 10:53:44.676736 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Accept-Encoding: identity Jul 21 10:53:44.676736 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Connection: close Jul 21 10:53:44.676736 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Content-Length: 0 Jul 21 10:53:44.676736 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Content-Type: application/json Jul 21 10:53:44.676736 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Host: 10.222.0.48 Jul 21 10:53:44.676736 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Openstack-System-Scope: None Jul 21 10:53:44.676736 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: User-Agent: python-urllib3/1.26.9 Jul 21 10:53:44.676736 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Auth-Token: gAAAAABi2S6IjD13fpvyB3gT_wfBhrxBWJW9IyP2Nfh-tKREma2qJlItcJifOI1FikOPoU86kC4jMPIUJv7c1XQEgHyn13RPV4dm8YXLpWP83NoB7MDue-0ef8jz1-9ETLoC72jgbX7x_bNoV_fia9kSfgVPDrqxya-pNvknwmV6TjdQwJPLki8 Jul 21 10:53:44.676736 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Domain-Id: None Jul 21 10:53:44.676736 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Domain-Name: None Jul 21 10:53:44.676736 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Identity-Status: Confirmed Jul 21 10:53:44.676736 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Is-Admin-Project: True Jul 21 10:53:44.676736 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Domain-Id: default Jul 21 10:53:44.676736 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Domain-Name: Default Jul 21 10:53:44.676736 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Id: 0dc215aadb5345d791945658832aae4a Jul 21 10:53:44.676736 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Name: tempest-AttachVolumeNegativeTest-692763952 Jul 21 10:53:44.676736 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Role: reader,member Jul 21 10:53:44.676736 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Roles: reader,member Jul 21 10:53:44.685154 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0dc215aadb5345d791945658832aae4a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0dc215aadb5345d791945658832aae4a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0dc215aadb5345d791945658832aae4a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0dc215aadb5345d791945658832aae4a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] Jul 21 10:53:44.685154 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Tenant: tempest-AttachVolumeNegativeTest-692763952 Jul 21 10:53:44.685154 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Tenant-Id: 0dc215aadb5345d791945658832aae4a Jul 21 10:53:44.685154 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-692763952 Jul 21 10:53:44.685154 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User: tempest-AttachVolumeNegativeTest-692763952-project Jul 21 10:53:44.685154 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Domain-Id: default Jul 21 10:53:44.685154 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Domain-Name: Default Jul 21 10:53:44.685154 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Id: 906e4bc4e9cc45ecb01cfca7918e461d Jul 21 10:53:44.685154 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Name: tempest-AttachVolumeNegativeTest-692763952-project Jul 21 10:53:44.685154 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: method: > Jul 21 10:53:44.685154 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: exception: Instance 73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b could not be found. Jul 21 10:53:44.685154 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: action_args: {'id': '73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b'} Jul 21 10:53:44.686057 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 10:53:44.686057 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:53:44.686057 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 10:53:44.686057 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 10:53:44.686057 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 10:53:44.686057 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 10:53:44.686057 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 10:53:44.686057 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 10:53:44.686057 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 10:53:44.686057 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 10:53:44.686057 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b could not be found. Jul 21 10:53:44.686057 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:53:44.686057 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:53:44.686057 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:53:44.686057 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:53:44.686057 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:53:44.686057 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:53:44.686057 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 10:53:44.686057 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 10:53:44.686057 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 10:53:44.687544 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 10:53:44.687544 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 21 10:53:44.687544 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 21 10:53:44.687544 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 21 10:53:44.687544 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 21 10:53:44.687544 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 10:53:44.687544 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 10:53:44.687544 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 10:53:44.687544 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 10:53:44.687544 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b could not be found. Jul 21 10:53:44.687544 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:53:44.687544 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:53:44.687544 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:53:44.687544 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:53:44.687544 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:53:44.687544 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:53:44.687544 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 10:53:44.687544 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 10:53:44.687544 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b could not be found. Jul 21 10:53:44.687544 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:53:44.689067 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-52671619-956b-454b-9acb-9abc7c18258c tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Returning 404 to user: Instance 73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b could not be found. {{(pid=124868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 10:53:44.689067 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-52671619-956b-454b-9acb-9abc7c18258c tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "DELETE /compute/v2.1/servers/73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b" status: 404 len: 111 microversion: 2.1 time: 0.032920 Jul 21 10:53:44.689067 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 453/918] 10.222.0.48 () {58 vars in 1238 bytes} [Thu Jul 21 10:53:44 2022] DELETE /compute/v2.1/servers/73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 10:53:44.690300 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-607ffa2d-927e-413d-86d5-1cc070f7941d tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:53:44.690953 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-607ffa2d-927e-413d-86d5-1cc070f7941d tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:53:44.696866 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-607ffa2d-927e-413d-86d5-1cc070f7941d tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:44.697308 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-607ffa2d-927e-413d-86d5-1cc070f7941d tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:44.698088 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-607ffa2d-927e-413d-86d5-1cc070f7941d tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:44.698519 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-607ffa2d-927e-413d-86d5-1cc070f7941d tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:44.712485 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.wsgi [None req-607ffa2d-927e-413d-86d5-1cc070f7941d tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] HTTP exception thrown: Instance 73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b could not be found. Jul 21 10:53:44.714261 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-607ffa2d-927e-413d-86d5-1cc070f7941d tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Request method failure captured: Jul 21 10:53:44.714261 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: request: GET /compute/v2.1/servers/73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b HTTP/1.1 Jul 21 10:53:44.714261 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Accept: application/json Jul 21 10:53:44.714261 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Accept-Encoding: identity Jul 21 10:53:44.714261 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Connection: close Jul 21 10:53:44.714261 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Content-Length: 0 Jul 21 10:53:44.714261 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Content-Type: application/json Jul 21 10:53:44.714261 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Host: 10.222.0.48 Jul 21 10:53:44.714261 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Openstack-System-Scope: None Jul 21 10:53:44.714261 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: User-Agent: python-urllib3/1.26.9 Jul 21 10:53:44.714261 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Auth-Token: gAAAAABi2S6IjD13fpvyB3gT_wfBhrxBWJW9IyP2Nfh-tKREma2qJlItcJifOI1FikOPoU86kC4jMPIUJv7c1XQEgHyn13RPV4dm8YXLpWP83NoB7MDue-0ef8jz1-9ETLoC72jgbX7x_bNoV_fia9kSfgVPDrqxya-pNvknwmV6TjdQwJPLki8 Jul 21 10:53:44.714261 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Domain-Id: None Jul 21 10:53:44.714261 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Domain-Name: None Jul 21 10:53:44.714261 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Identity-Status: Confirmed Jul 21 10:53:44.714261 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Is-Admin-Project: True Jul 21 10:53:44.714261 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Project-Domain-Id: default Jul 21 10:53:44.714261 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Project-Domain-Name: Default Jul 21 10:53:44.714261 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Project-Id: 0dc215aadb5345d791945658832aae4a Jul 21 10:53:44.714261 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Project-Name: tempest-AttachVolumeNegativeTest-692763952 Jul 21 10:53:44.714261 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Role: reader,member Jul 21 10:53:44.714261 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Roles: reader,member Jul 21 10:53:44.715729 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0dc215aadb5345d791945658832aae4a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0dc215aadb5345d791945658832aae4a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0dc215aadb5345d791945658832aae4a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0dc215aadb5345d791945658832aae4a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] Jul 21 10:53:44.715729 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Tenant: tempest-AttachVolumeNegativeTest-692763952 Jul 21 10:53:44.715729 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Tenant-Id: 0dc215aadb5345d791945658832aae4a Jul 21 10:53:44.715729 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-692763952 Jul 21 10:53:44.715729 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User: tempest-AttachVolumeNegativeTest-692763952-project Jul 21 10:53:44.715729 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User-Domain-Id: default Jul 21 10:53:44.715729 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User-Domain-Name: Default Jul 21 10:53:44.715729 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User-Id: 906e4bc4e9cc45ecb01cfca7918e461d Jul 21 10:53:44.715729 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User-Name: tempest-AttachVolumeNegativeTest-692763952-project Jul 21 10:53:44.715729 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: method: > Jul 21 10:53:44.715729 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: exception: Instance 73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b could not be found. Jul 21 10:53:44.715729 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: action_args: {'id': '73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b'} Jul 21 10:53:44.719202 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 10:53:44.719202 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:53:44.719202 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 10:53:44.719202 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 10:53:44.719202 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 10:53:44.719202 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 10:53:44.719202 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 10:53:44.719202 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 10:53:44.719202 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 10:53:44.719202 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 10:53:44.719202 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b could not be found. Jul 21 10:53:44.719202 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:53:44.719202 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:53:44.719202 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:53:44.719202 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:53:44.719202 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:53:44.719202 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:53:44.719202 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 10:53:44.719202 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 10:53:44.719202 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 10:53:44.720663 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 10:53:44.720663 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 10:53:44.720663 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 10:53:44.720663 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 10:53:44.720663 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 10:53:44.720663 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 10:53:44.720663 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 10:53:44.720663 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b could not be found. Jul 21 10:53:44.720663 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:53:44.720663 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:53:44.720663 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:53:44.720663 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:53:44.720663 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:53:44.720663 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:53:44.720663 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 10:53:44.720663 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 10:53:44.720663 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b could not be found. Jul 21 10:53:44.720663 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:53:44.722182 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-607ffa2d-927e-413d-86d5-1cc070f7941d tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Returning 404 to user: Instance 73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b could not be found. {{(pid=124867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 10:53:44.722182 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-607ffa2d-927e-413d-86d5-1cc070f7941d tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b" status: 404 len: 111 microversion: 2.1 time: 0.030606 Jul 21 10:53:44.722182 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 466/919] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:53:44 2022] GET /compute/v2.1/servers/73ce0024-40d1-4e7d-a6a0-0c57c6a3d66b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 10:53:44.771454 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [req-0b264e3e-94f9-42d1-b298-fd7c104f7f65 req-aadb25ef-5e75-41ad-99db-cc280a1085ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb24f843-eeb3-43dd-bd48-3bcf68e344cd", "name": "network-vif-plugged", "status": "completed", "tag": "2741d1f0-6bcb-4bee-8842-bc9bf8bc4db2"}]} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:53:44.780016 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-0b264e3e-94f9-42d1-b298-fd7c104f7f65 req-aadb25ef-5e75-41ad-99db-cc280a1085ff service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:44.780464 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-0b264e3e-94f9-42d1-b298-fd7c104f7f65 req-aadb25ef-5e75-41ad-99db-cc280a1085ff service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:44.792589 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.compute.server_external_events [req-0b264e3e-94f9-42d1-b298-fd7c104f7f65 req-aadb25ef-5e75-41ad-99db-cc280a1085ff service nova] Creating event network-vif-plugged:2741d1f0-6bcb-4bee-8842-bc9bf8bc4db2 for instance eb24f843-eeb3-43dd-bd48-3bcf68e344cd on hv-cinder-84980 Jul 21 10:53:44.798588 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [req-0b264e3e-94f9-42d1-b298-fd7c104f7f65 req-aadb25ef-5e75-41ad-99db-cc280a1085ff service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032043 Jul 21 10:53:44.799411 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 454/920] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 21 10:53:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:53:44.965305 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-c98b70f8-aa49-4f56-b5c8-dc816cff717e tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:53:44.966017 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-c98b70f8-aa49-4f56-b5c8-dc816cff717e tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] [instance: eb24f843-eeb3-43dd-bd48-3bcf68e344cd] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:53:44.973579 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c98b70f8-aa49-4f56-b5c8-dc816cff717e tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:44.974235 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c98b70f8-aa49-4f56-b5c8-dc816cff717e tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:44.975050 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c98b70f8-aa49-4f56-b5c8-dc816cff717e tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:44.975772 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c98b70f8-aa49-4f56-b5c8-dc816cff717e tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:45.120626 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-c98b70f8-aa49-4f56-b5c8-dc816cff717e tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e3fd195fd14b009ba56950dc542cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620ea9c4eaa74dc5858cf93d9fcad9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:45.129529 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-c98b70f8-aa49-4f56-b5c8-dc816cff717e tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] 10.222.0.48 "GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd" status: 200 len: 1577 microversion: 2.1 time: 0.168303 Jul 21 10:53:45.130205 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 467/921] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:53:44 2022] GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd => generated 1577 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:53:46.044387 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-72daa038-53e0-47d0-8336-28bd92d5935d tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:53:46.045003 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-72daa038-53e0-47d0-8336-28bd92d5935d tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 691ae8fc-92e7-4940-99d8-7edb5a96d2f3] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:53:46.052491 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-72daa038-53e0-47d0-8336-28bd92d5935d tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:46.052942 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-72daa038-53e0-47d0-8336-28bd92d5935d tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:46.053699 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-72daa038-53e0-47d0-8336-28bd92d5935d tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:46.054137 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-72daa038-53e0-47d0-8336-28bd92d5935d tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:46.068514 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.wsgi [None req-72daa038-53e0-47d0-8336-28bd92d5935d tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] HTTP exception thrown: Instance 691ae8fc-92e7-4940-99d8-7edb5a96d2f3 could not be found. Jul 21 10:53:46.070294 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-72daa038-53e0-47d0-8336-28bd92d5935d tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Request method failure captured: Jul 21 10:53:46.070294 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: request: DELETE /compute/v2.1/servers/691ae8fc-92e7-4940-99d8-7edb5a96d2f3 HTTP/1.1 Jul 21 10:53:46.070294 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Accept: application/json Jul 21 10:53:46.070294 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Accept-Encoding: identity Jul 21 10:53:46.070294 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Connection: close Jul 21 10:53:46.070294 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Content-Length: 0 Jul 21 10:53:46.070294 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Content-Type: application/json Jul 21 10:53:46.070294 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Host: 10.222.0.48 Jul 21 10:53:46.070294 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Openstack-System-Scope: None Jul 21 10:53:46.070294 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: User-Agent: python-urllib3/1.26.9 Jul 21 10:53:46.070294 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Auth-Token: gAAAAABi2S6IjD13fpvyB3gT_wfBhrxBWJW9IyP2Nfh-tKREma2qJlItcJifOI1FikOPoU86kC4jMPIUJv7c1XQEgHyn13RPV4dm8YXLpWP83NoB7MDue-0ef8jz1-9ETLoC72jgbX7x_bNoV_fia9kSfgVPDrqxya-pNvknwmV6TjdQwJPLki8 Jul 21 10:53:46.070294 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Domain-Id: None Jul 21 10:53:46.070294 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Domain-Name: None Jul 21 10:53:46.070294 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Identity-Status: Confirmed Jul 21 10:53:46.070294 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Is-Admin-Project: True Jul 21 10:53:46.070294 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Domain-Id: default Jul 21 10:53:46.070294 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Domain-Name: Default Jul 21 10:53:46.070294 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Id: 0dc215aadb5345d791945658832aae4a Jul 21 10:53:46.070294 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Name: tempest-AttachVolumeNegativeTest-692763952 Jul 21 10:53:46.070294 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Role: reader,member Jul 21 10:53:46.070294 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Roles: reader,member Jul 21 10:53:46.071700 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0dc215aadb5345d791945658832aae4a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0dc215aadb5345d791945658832aae4a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0dc215aadb5345d791945658832aae4a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0dc215aadb5345d791945658832aae4a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] Jul 21 10:53:46.071700 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Tenant: tempest-AttachVolumeNegativeTest-692763952 Jul 21 10:53:46.071700 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Tenant-Id: 0dc215aadb5345d791945658832aae4a Jul 21 10:53:46.071700 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-692763952 Jul 21 10:53:46.071700 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User: tempest-AttachVolumeNegativeTest-692763952-project Jul 21 10:53:46.071700 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Domain-Id: default Jul 21 10:53:46.071700 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Domain-Name: Default Jul 21 10:53:46.071700 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Id: 906e4bc4e9cc45ecb01cfca7918e461d Jul 21 10:53:46.071700 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Name: tempest-AttachVolumeNegativeTest-692763952-project Jul 21 10:53:46.071700 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: method: > Jul 21 10:53:46.071700 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: exception: Instance 691ae8fc-92e7-4940-99d8-7edb5a96d2f3 could not be found. Jul 21 10:53:46.071700 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: action_args: {'id': '691ae8fc-92e7-4940-99d8-7edb5a96d2f3'} Jul 21 10:53:46.072534 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 10:53:46.072534 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:53:46.072534 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 10:53:46.072534 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 10:53:46.072534 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 10:53:46.072534 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 10:53:46.072534 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 10:53:46.072534 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 10:53:46.072534 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 10:53:46.072534 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 10:53:46.072534 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 691ae8fc-92e7-4940-99d8-7edb5a96d2f3 could not be found. Jul 21 10:53:46.072534 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:53:46.072534 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:53:46.072534 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:53:46.072534 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:53:46.072534 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:53:46.072534 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:53:46.072534 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 10:53:46.072534 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 10:53:46.072534 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 10:53:46.073707 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 10:53:46.073707 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 21 10:53:46.073707 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 21 10:53:46.073707 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 21 10:53:46.073707 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 21 10:53:46.073707 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 10:53:46.073707 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 10:53:46.073707 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 10:53:46.073707 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 10:53:46.073707 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 691ae8fc-92e7-4940-99d8-7edb5a96d2f3 could not be found. Jul 21 10:53:46.073707 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:53:46.073707 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:53:46.073707 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:53:46.073707 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:53:46.073707 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:53:46.073707 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:53:46.073707 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 10:53:46.073707 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 10:53:46.073707 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 691ae8fc-92e7-4940-99d8-7edb5a96d2f3 could not be found. Jul 21 10:53:46.073707 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:53:46.074952 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-72daa038-53e0-47d0-8336-28bd92d5935d tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Returning 404 to user: Instance 691ae8fc-92e7-4940-99d8-7edb5a96d2f3 could not be found. {{(pid=124868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 10:53:46.074952 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-72daa038-53e0-47d0-8336-28bd92d5935d tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "DELETE /compute/v2.1/servers/691ae8fc-92e7-4940-99d8-7edb5a96d2f3" status: 404 len: 111 microversion: 2.1 time: 0.031651 Jul 21 10:53:46.074952 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 455/922] 10.222.0.48 () {58 vars in 1238 bytes} [Thu Jul 21 10:53:46 2022] DELETE /compute/v2.1/servers/691ae8fc-92e7-4940-99d8-7edb5a96d2f3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 10:53:46.080058 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-2318cd51-14cd-4457-9e6d-15bc3ed4ffec tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:53:46.083820 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-2318cd51-14cd-4457-9e6d-15bc3ed4ffec tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] [instance: 691ae8fc-92e7-4940-99d8-7edb5a96d2f3] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:53:46.087387 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2318cd51-14cd-4457-9e6d-15bc3ed4ffec tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:46.088209 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2318cd51-14cd-4457-9e6d-15bc3ed4ffec tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:46.088922 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2318cd51-14cd-4457-9e6d-15bc3ed4ffec tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:46.089356 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2318cd51-14cd-4457-9e6d-15bc3ed4ffec tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:46.103057 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.wsgi [None req-2318cd51-14cd-4457-9e6d-15bc3ed4ffec tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] HTTP exception thrown: Instance 691ae8fc-92e7-4940-99d8-7edb5a96d2f3 could not be found. Jul 21 10:53:46.104565 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-2318cd51-14cd-4457-9e6d-15bc3ed4ffec tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Request method failure captured: Jul 21 10:53:46.104565 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: request: GET /compute/v2.1/servers/691ae8fc-92e7-4940-99d8-7edb5a96d2f3 HTTP/1.1 Jul 21 10:53:46.104565 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Accept: application/json Jul 21 10:53:46.104565 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Accept-Encoding: identity Jul 21 10:53:46.104565 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Connection: close Jul 21 10:53:46.104565 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Content-Length: 0 Jul 21 10:53:46.104565 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Content-Type: application/json Jul 21 10:53:46.104565 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Host: 10.222.0.48 Jul 21 10:53:46.104565 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Openstack-System-Scope: None Jul 21 10:53:46.104565 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: User-Agent: python-urllib3/1.26.9 Jul 21 10:53:46.104565 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Auth-Token: gAAAAABi2S6IjD13fpvyB3gT_wfBhrxBWJW9IyP2Nfh-tKREma2qJlItcJifOI1FikOPoU86kC4jMPIUJv7c1XQEgHyn13RPV4dm8YXLpWP83NoB7MDue-0ef8jz1-9ETLoC72jgbX7x_bNoV_fia9kSfgVPDrqxya-pNvknwmV6TjdQwJPLki8 Jul 21 10:53:46.104565 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Domain-Id: None Jul 21 10:53:46.104565 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Domain-Name: None Jul 21 10:53:46.104565 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Identity-Status: Confirmed Jul 21 10:53:46.104565 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Is-Admin-Project: True Jul 21 10:53:46.104565 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Project-Domain-Id: default Jul 21 10:53:46.104565 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Project-Domain-Name: Default Jul 21 10:53:46.104565 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Project-Id: 0dc215aadb5345d791945658832aae4a Jul 21 10:53:46.104565 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Project-Name: tempest-AttachVolumeNegativeTest-692763952 Jul 21 10:53:46.104565 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Role: reader,member Jul 21 10:53:46.104565 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Roles: reader,member Jul 21 10:53:46.111250 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0dc215aadb5345d791945658832aae4a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0dc215aadb5345d791945658832aae4a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0dc215aadb5345d791945658832aae4a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0dc215aadb5345d791945658832aae4a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] Jul 21 10:53:46.111250 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Tenant: tempest-AttachVolumeNegativeTest-692763952 Jul 21 10:53:46.111250 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Tenant-Id: 0dc215aadb5345d791945658832aae4a Jul 21 10:53:46.111250 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-692763952 Jul 21 10:53:46.111250 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User: tempest-AttachVolumeNegativeTest-692763952-project Jul 21 10:53:46.111250 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User-Domain-Id: default Jul 21 10:53:46.111250 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User-Domain-Name: Default Jul 21 10:53:46.111250 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User-Id: 906e4bc4e9cc45ecb01cfca7918e461d Jul 21 10:53:46.111250 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User-Name: tempest-AttachVolumeNegativeTest-692763952-project Jul 21 10:53:46.111250 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: method: > Jul 21 10:53:46.111250 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: exception: Instance 691ae8fc-92e7-4940-99d8-7edb5a96d2f3 could not be found. Jul 21 10:53:46.111250 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: action_args: {'id': '691ae8fc-92e7-4940-99d8-7edb5a96d2f3'} Jul 21 10:53:46.113863 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 10:53:46.113863 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:53:46.113863 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 10:53:46.113863 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 10:53:46.113863 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 10:53:46.113863 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 10:53:46.113863 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 10:53:46.113863 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 10:53:46.113863 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 10:53:46.113863 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 10:53:46.113863 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 691ae8fc-92e7-4940-99d8-7edb5a96d2f3 could not be found. Jul 21 10:53:46.113863 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:53:46.113863 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:53:46.113863 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:53:46.113863 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:53:46.113863 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:53:46.113863 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:53:46.113863 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 10:53:46.113863 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 10:53:46.113863 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 10:53:46.115947 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 10:53:46.115947 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 10:53:46.115947 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 10:53:46.115947 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 10:53:46.115947 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 10:53:46.115947 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 10:53:46.115947 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 10:53:46.115947 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 691ae8fc-92e7-4940-99d8-7edb5a96d2f3 could not be found. Jul 21 10:53:46.115947 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:53:46.115947 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:53:46.115947 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:53:46.115947 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:53:46.115947 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:53:46.115947 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:53:46.115947 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 10:53:46.115947 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 10:53:46.115947 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 691ae8fc-92e7-4940-99d8-7edb5a96d2f3 could not be found. Jul 21 10:53:46.115947 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:53:46.117515 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-2318cd51-14cd-4457-9e6d-15bc3ed4ffec tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] Returning 404 to user: Instance 691ae8fc-92e7-4940-99d8-7edb5a96d2f3 could not be found. {{(pid=124867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 10:53:46.117515 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-2318cd51-14cd-4457-9e6d-15bc3ed4ffec tempest-AttachVolumeNegativeTest-692763952 tempest-AttachVolumeNegativeTest-692763952-project] 10.222.0.48 "GET /compute/v2.1/servers/691ae8fc-92e7-4940-99d8-7edb5a96d2f3" status: 404 len: 111 microversion: 2.1 time: 0.029637 Jul 21 10:53:46.117515 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 468/923] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:53:46 2022] GET /compute/v2.1/servers/691ae8fc-92e7-4940-99d8-7edb5a96d2f3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 10:53:46.146832 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-8c0e1f7d-1fd0-4e81-a2fd-6b8d7faa049f tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:53:46.147475 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-8c0e1f7d-1fd0-4e81-a2fd-6b8d7faa049f tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] [instance: eb24f843-eeb3-43dd-bd48-3bcf68e344cd] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:53:46.153871 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8c0e1f7d-1fd0-4e81-a2fd-6b8d7faa049f tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:46.154324 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8c0e1f7d-1fd0-4e81-a2fd-6b8d7faa049f tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:46.155209 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8c0e1f7d-1fd0-4e81-a2fd-6b8d7faa049f tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:46.155759 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8c0e1f7d-1fd0-4e81-a2fd-6b8d7faa049f tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:46.317585 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-8c0e1f7d-1fd0-4e81-a2fd-6b8d7faa049f tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e3fd195fd14b009ba56950dc542cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620ea9c4eaa74dc5858cf93d9fcad9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:46.327424 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-8c0e1f7d-1fd0-4e81-a2fd-6b8d7faa049f tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] 10.222.0.48 "GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd" status: 200 len: 1577 microversion: 2.1 time: 0.184426 Jul 21 10:53:46.332998 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 456/924] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:53:46 2022] GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd => generated 1577 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:53:47.346945 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-12c5e7e2-3b7c-4170-ad07-8a10eeb76ec8 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:53:47.348615 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-12c5e7e2-3b7c-4170-ad07-8a10eeb76ec8 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] [instance: eb24f843-eeb3-43dd-bd48-3bcf68e344cd] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:53:47.357760 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-12c5e7e2-3b7c-4170-ad07-8a10eeb76ec8 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:47.358201 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-12c5e7e2-3b7c-4170-ad07-8a10eeb76ec8 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:47.359205 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-12c5e7e2-3b7c-4170-ad07-8a10eeb76ec8 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:53:47.359645 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-12c5e7e2-3b7c-4170-ad07-8a10eeb76ec8 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:53:47.507608 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-12c5e7e2-3b7c-4170-ad07-8a10eeb76ec8 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e3fd195fd14b009ba56950dc542cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620ea9c4eaa74dc5858cf93d9fcad9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:53:47.515756 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-12c5e7e2-3b7c-4170-ad07-8a10eeb76ec8 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] 10.222.0.48 "GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd" status: 200 len: 1564 microversion: 2.1 time: 0.174331 Jul 21 10:53:47.516332 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 469/925] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:53:47 2022] GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd => generated 1564 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:54:07.009016 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-728fdb05-ae12-468a-be09-782493b3374b tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1803857168", "imageRef": "282ddb30-fa0f-489d-9cc3-a3e70e03c631", "flavorRef": "452", "networks": [{"uuid": "8ceaccac-b641-4f35-9f06-627723dcabd5"}]}} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:54:07.015919 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_api:SELECT=48,nova_api:DELETE=1 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:54:07.020034 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell1:SELECT=22 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:54:07.062992 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.network.neutron [None req-728fdb05-ae12-468a-be09-782493b3374b tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] validate_networks() for [('8ceaccac-b641-4f35-9f06-627723dcabd5', None, None, None, None, None)] {{(pid=124868) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 10:54:07.415399 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.virt.hardware [None req-728fdb05-ae12-468a-be09-782493b3374b tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Flavor limits 0:0:0 {{(pid=124868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 10:54:07.415823 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.virt.hardware [None req-728fdb05-ae12-468a-be09-782493b3374b tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Image limits 0:0:0 {{(pid=124868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 10:54:07.416295 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.virt.hardware [None req-728fdb05-ae12-468a-be09-782493b3374b tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Flavor pref 0:0:0 {{(pid=124868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 10:54:07.416706 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.virt.hardware [None req-728fdb05-ae12-468a-be09-782493b3374b tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Image pref 0:0:0 {{(pid=124868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 10:54:07.417121 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.virt.hardware [None req-728fdb05-ae12-468a-be09-782493b3374b tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 10:54:07.426110 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-728fdb05-ae12-468a-be09-782493b3374b tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:07.426576 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-728fdb05-ae12-468a-be09-782493b3374b tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:07.427380 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-728fdb05-ae12-468a-be09-782493b3374b tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:07.427817 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-728fdb05-ae12-468a-be09-782493b3374b tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:07.446156 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.quota [None req-728fdb05-ae12-468a-be09-782493b3374b tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Getting quotas for project 0f5f72a0f2054b89bb61968a2de9f10a. Resources: {'ram', 'instances', 'cores'} {{(pid=124868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 10:54:07.450234 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.quota [None req-728fdb05-ae12-468a-be09-782493b3374b tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Getting quotas for user 1d04261c643948c0b7d9a20579c52dae and project 0f5f72a0f2054b89bb61968a2de9f10a. Resources: {'ram', 'instances', 'cores'} {{(pid=124868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 10:54:07.461923 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-728fdb05-ae12-468a-be09-782493b3374b tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Going to run 1 instances... {{(pid=124868) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 10:54:07.464456 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-728fdb05-ae12-468a-be09-782493b3374b tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] [instance: dd3e9cc4-2396-4388-a748-85fe1055d4c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='282ddb30-fa0f-489d-9cc3-a3e70e03c631',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 10:54:07.576597 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-728fdb05-ae12-468a-be09-782493b3374b tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.571425 Jul 21 10:54:07.577426 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 457/926] 10.222.0.48 () {60 vars in 1146 bytes} [Thu Jul 21 10:54:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 573 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 10:54:07.588562 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-404bd29f-c604-4379-b00b-75205d7e5c20 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:54:07.589198 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-404bd29f-c604-4379-b00b-75205d7e5c20 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] [instance: dd3e9cc4-2396-4388-a748-85fe1055d4c7] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:54:07.592474 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_api:SELECT=25 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:54:07.593315 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell1:SELECT=39 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:54:07.651460 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-404bd29f-c604-4379-b00b-75205d7e5c20 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d04261c643948c0b7d9a20579c52dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f5f72a0f2054b89bb61968a2de9f10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:54:07.660654 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-404bd29f-c604-4379-b00b-75205d7e5c20 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3e9cc4-2396-4388-a748-85fe1055d4c7" status: 200 len: 1214 microversion: 2.1 time: 0.076183 Jul 21 10:54:07.666116 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 470/927] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:54:07 2022] GET /compute/v2.1/servers/dd3e9cc4-2396-4388-a748-85fe1055d4c7 => generated 1214 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:54:08.682486 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-970916fc-b477-473a-bf72-5f886915d7de tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:54:08.683241 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-970916fc-b477-473a-bf72-5f886915d7de tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] [instance: dd3e9cc4-2396-4388-a748-85fe1055d4c7] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:54:08.689713 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-970916fc-b477-473a-bf72-5f886915d7de tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:08.690318 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-970916fc-b477-473a-bf72-5f886915d7de tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:08.691459 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-970916fc-b477-473a-bf72-5f886915d7de tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:08.691899 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-970916fc-b477-473a-bf72-5f886915d7de tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:08.758430 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-970916fc-b477-473a-bf72-5f886915d7de tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d04261c643948c0b7d9a20579c52dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f5f72a0f2054b89bb61968a2de9f10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:54:08.767695 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-970916fc-b477-473a-bf72-5f886915d7de tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3e9cc4-2396-4388-a748-85fe1055d4c7" status: 200 len: 1218 microversion: 2.1 time: 0.089770 Jul 21 10:54:08.768315 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 458/928] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:54:08 2022] GET /compute/v2.1/servers/dd3e9cc4-2396-4388-a748-85fe1055d4c7 => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:54:09.785585 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-f6ad208d-8dd7-4d77-bcd9-d52747fa14d1 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:54:09.786370 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-f6ad208d-8dd7-4d77-bcd9-d52747fa14d1 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] [instance: dd3e9cc4-2396-4388-a748-85fe1055d4c7] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:54:09.792714 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f6ad208d-8dd7-4d77-bcd9-d52747fa14d1 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:09.793164 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f6ad208d-8dd7-4d77-bcd9-d52747fa14d1 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:09.793929 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f6ad208d-8dd7-4d77-bcd9-d52747fa14d1 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:09.794356 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f6ad208d-8dd7-4d77-bcd9-d52747fa14d1 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:09.862049 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-f6ad208d-8dd7-4d77-bcd9-d52747fa14d1 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d04261c643948c0b7d9a20579c52dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f5f72a0f2054b89bb61968a2de9f10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:54:09.870522 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-f6ad208d-8dd7-4d77-bcd9-d52747fa14d1 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3e9cc4-2396-4388-a748-85fe1055d4c7" status: 200 len: 1274 microversion: 2.1 time: 0.089043 Jul 21 10:54:09.871168 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 471/929] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:54:09 2022] GET /compute/v2.1/servers/dd3e9cc4-2396-4388-a748-85fe1055d4c7 => generated 1274 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:54:10.731663 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-b29705e7-811b-4ef7-a8ce-b4520c6d687e tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:54:10.732690 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-b29705e7-811b-4ef7-a8ce-b4520c6d687e tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 68c9ec60-9f75-4491-a780-6c339cc6d445] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:54:10.741579 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b29705e7-811b-4ef7-a8ce-b4520c6d687e tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:10.742030 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b29705e7-811b-4ef7-a8ce-b4520c6d687e tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:10.742841 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b29705e7-811b-4ef7-a8ce-b4520c6d687e tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:10.743471 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b29705e7-811b-4ef7-a8ce-b4520c6d687e tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:10.773799 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-b29705e7-811b-4ef7-a8ce-b4520c6d687e tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046389 Jul 21 10:54:10.774347 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 459/930] 10.222.0.48 () {60 vars in 1342 bytes} [Thu Jul 21 10:54:10 2022] GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:54:10.831954 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-b32259a7-00e2-4e85-83fa-caa82dbbb44f tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:54:10.832432 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-b32259a7-00e2-4e85-83fa-caa82dbbb44f tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 68c9ec60-9f75-4491-a780-6c339cc6d445] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:54:10.839274 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b32259a7-00e2-4e85-83fa-caa82dbbb44f tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:10.839720 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b32259a7-00e2-4e85-83fa-caa82dbbb44f tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:10.840479 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b32259a7-00e2-4e85-83fa-caa82dbbb44f tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:10.841170 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b32259a7-00e2-4e85-83fa-caa82dbbb44f tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:10.867436 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-b32259a7-00e2-4e85-83fa-caa82dbbb44f tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 68c9ec60-9f75-4491-a780-6c339cc6d445] Going to try to terminate instance {{(pid=124867) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 10:54:10.891110 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-7675d7bc-a61a-4760-8d44-259b3386355e tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:54:10.892159 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-7675d7bc-a61a-4760-8d44-259b3386355e tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] [instance: dd3e9cc4-2396-4388-a748-85fe1055d4c7] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:54:10.899468 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7675d7bc-a61a-4760-8d44-259b3386355e tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:10.900065 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7675d7bc-a61a-4760-8d44-259b3386355e tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:10.900967 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7675d7bc-a61a-4760-8d44-259b3386355e tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:10.901542 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7675d7bc-a61a-4760-8d44-259b3386355e tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:11.051111 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-7675d7bc-a61a-4760-8d44-259b3386355e tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d04261c643948c0b7d9a20579c52dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f5f72a0f2054b89bb61968a2de9f10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:54:11.064166 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-7675d7bc-a61a-4760-8d44-259b3386355e tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3e9cc4-2396-4388-a748-85fe1055d4c7" status: 200 len: 1314 microversion: 2.1 time: 0.178831 Jul 21 10:54:11.064740 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 460/931] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:54:10 2022] GET /compute/v2.1/servers/dd3e9cc4-2396-4388-a748-85fe1055d4c7 => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:54:11.215905 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-b32259a7-00e2-4e85-83fa-caa82dbbb44f tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "DELETE /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445" status: 204 len: 0 microversion: 2.20 time: 0.387303 Jul 21 10:54:11.218354 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 472/932] 10.222.0.48 () {60 vars in 1279 bytes} [Thu Jul 21 10:54:10 2022] DELETE /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 21 10:54:11.229368 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-9ee166a1-b0da-4dd9-9b74-e4f2b558d1b1 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:54:11.230019 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-9ee166a1-b0da-4dd9-9b74-e4f2b558d1b1 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 68c9ec60-9f75-4491-a780-6c339cc6d445] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:54:11.236463 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9ee166a1-b0da-4dd9-9b74-e4f2b558d1b1 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:11.236828 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9ee166a1-b0da-4dd9-9b74-e4f2b558d1b1 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:11.237602 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9ee166a1-b0da-4dd9-9b74-e4f2b558d1b1 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:11.238038 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9ee166a1-b0da-4dd9-9b74-e4f2b558d1b1 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:11.390658 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-9ee166a1-b0da-4dd9-9b74-e4f2b558d1b1 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:54:11.401719 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-9ee166a1-b0da-4dd9-9b74-e4f2b558d1b1 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:54:11.404406 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-9ee166a1-b0da-4dd9-9b74-e4f2b558d1b1 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:54:11.405956 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-9ee166a1-b0da-4dd9-9b74-e4f2b558d1b1 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445" status: 200 len: 1722 microversion: 2.20 time: 0.184519 Jul 21 10:54:11.406772 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 461/933] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:54:11 2022] GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445 => generated 1722 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:54:11.646170 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [req-b9732782-8807-4e27-bfa1-68c079054c32 req-1485a0f7-38ec-4515-bc6e-690df1f93204 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd3e9cc4-2396-4388-a748-85fe1055d4c7", "tag": "ac28d821-fded-4f58-b25c-ad117a60ed94"}]} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:54:11.657659 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-b9732782-8807-4e27-bfa1-68c079054c32 req-1485a0f7-38ec-4515-bc6e-690df1f93204 service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:11.658213 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-b9732782-8807-4e27-bfa1-68c079054c32 req-1485a0f7-38ec-4515-bc6e-690df1f93204 service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:11.674881 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.compute.server_external_events [req-b9732782-8807-4e27-bfa1-68c079054c32 req-1485a0f7-38ec-4515-bc6e-690df1f93204 service nova] Creating event network-changed:ac28d821-fded-4f58-b25c-ad117a60ed94 for instance dd3e9cc4-2396-4388-a748-85fe1055d4c7 on hv-cinder-84980 Jul 21 10:54:11.679805 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [req-b9732782-8807-4e27-bfa1-68c079054c32 req-1485a0f7-38ec-4515-bc6e-690df1f93204 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039354 Jul 21 10:54:11.680538 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 473/934] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 21 10:54:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:54:12.084184 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-43f0e7b7-98e5-40c4-baab-ccde416af956 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:54:12.084721 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-43f0e7b7-98e5-40c4-baab-ccde416af956 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] [instance: dd3e9cc4-2396-4388-a748-85fe1055d4c7] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:54:12.091343 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-43f0e7b7-98e5-40c4-baab-ccde416af956 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:12.091785 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-43f0e7b7-98e5-40c4-baab-ccde416af956 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:12.092537 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-43f0e7b7-98e5-40c4-baab-ccde416af956 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:12.093004 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-43f0e7b7-98e5-40c4-baab-ccde416af956 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:12.232380 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-43f0e7b7-98e5-40c4-baab-ccde416af956 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d04261c643948c0b7d9a20579c52dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f5f72a0f2054b89bb61968a2de9f10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:54:12.240684 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-43f0e7b7-98e5-40c4-baab-ccde416af956 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3e9cc4-2396-4388-a748-85fe1055d4c7" status: 200 len: 1314 microversion: 2.1 time: 0.161259 Jul 21 10:54:12.241484 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 462/935] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:54:12 2022] GET /compute/v2.1/servers/dd3e9cc4-2396-4388-a748-85fe1055d4c7 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:54:12.428402 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-d04ccd41-ae13-45a1-a1ff-c12da247d9e3 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:54:12.429139 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-d04ccd41-ae13-45a1-a1ff-c12da247d9e3 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 68c9ec60-9f75-4491-a780-6c339cc6d445] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:54:12.435889 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d04ccd41-ae13-45a1-a1ff-c12da247d9e3 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:12.436329 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d04ccd41-ae13-45a1-a1ff-c12da247d9e3 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:12.437083 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d04ccd41-ae13-45a1-a1ff-c12da247d9e3 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:12.437512 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d04ccd41-ae13-45a1-a1ff-c12da247d9e3 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:12.575800 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-d04ccd41-ae13-45a1-a1ff-c12da247d9e3 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:54:12.583430 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-d04ccd41-ae13-45a1-a1ff-c12da247d9e3 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:54:12.584931 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-d04ccd41-ae13-45a1-a1ff-c12da247d9e3 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:54:12.586107 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-d04ccd41-ae13-45a1-a1ff-c12da247d9e3 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445" status: 200 len: 1722 microversion: 2.20 time: 0.163393 Jul 21 10:54:12.586682 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 474/936] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:54:12 2022] GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:54:13.262981 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-e2e330ee-fe04-445b-bd15-bd3179106553 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:54:13.263603 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-e2e330ee-fe04-445b-bd15-bd3179106553 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] [instance: dd3e9cc4-2396-4388-a748-85fe1055d4c7] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:54:13.271058 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e2e330ee-fe04-445b-bd15-bd3179106553 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:13.271524 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e2e330ee-fe04-445b-bd15-bd3179106553 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:13.272303 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e2e330ee-fe04-445b-bd15-bd3179106553 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:13.272749 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e2e330ee-fe04-445b-bd15-bd3179106553 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:13.409159 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-e2e330ee-fe04-445b-bd15-bd3179106553 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d04261c643948c0b7d9a20579c52dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f5f72a0f2054b89bb61968a2de9f10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:54:13.416586 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-e2e330ee-fe04-445b-bd15-bd3179106553 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3e9cc4-2396-4388-a748-85fe1055d4c7" status: 200 len: 1314 microversion: 2.1 time: 0.162579 Jul 21 10:54:13.417163 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 463/937] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:54:13 2022] GET /compute/v2.1/servers/dd3e9cc4-2396-4388-a748-85fe1055d4c7 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:54:13.605995 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-e7781dce-ef33-47c6-aac5-484188a0a6a0 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:54:13.606806 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-e7781dce-ef33-47c6-aac5-484188a0a6a0 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 68c9ec60-9f75-4491-a780-6c339cc6d445] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:54:13.616293 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e7781dce-ef33-47c6-aac5-484188a0a6a0 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:13.616809 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e7781dce-ef33-47c6-aac5-484188a0a6a0 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:13.617937 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e7781dce-ef33-47c6-aac5-484188a0a6a0 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:13.618439 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e7781dce-ef33-47c6-aac5-484188a0a6a0 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:13.758227 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-e7781dce-ef33-47c6-aac5-484188a0a6a0 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:54:13.767478 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-e7781dce-ef33-47c6-aac5-484188a0a6a0 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:54:13.769033 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-e7781dce-ef33-47c6-aac5-484188a0a6a0 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:54:13.770240 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-e7781dce-ef33-47c6-aac5-484188a0a6a0 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445" status: 200 len: 1722 microversion: 2.20 time: 0.169082 Jul 21 10:54:13.771450 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 475/938] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:54:13 2022] GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 10:54:14.063387 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [req-e7e38d66-8171-485a-bd00-c1d13df89d98 req-e90655d3-b84f-4b3b-84e7-d4bcc4a2084e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68c9ec60-9f75-4491-a780-6c339cc6d445", "name": "network-vif-deleted", "tag": "767a932c-587b-4501-b928-eef9dd00de9e"}]} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:54:14.072571 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-e7e38d66-8171-485a-bd00-c1d13df89d98 req-e90655d3-b84f-4b3b-84e7-d4bcc4a2084e service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:14.073104 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-e7e38d66-8171-485a-bd00-c1d13df89d98 req-e90655d3-b84f-4b3b-84e7-d4bcc4a2084e service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:14.086457 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.compute.server_external_events [req-e7e38d66-8171-485a-bd00-c1d13df89d98 req-e90655d3-b84f-4b3b-84e7-d4bcc4a2084e service nova] Creating event network-vif-deleted:767a932c-587b-4501-b928-eef9dd00de9e for instance 68c9ec60-9f75-4491-a780-6c339cc6d445 on hv-cinder-84980 Jul 21 10:54:14.091879 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [req-e7e38d66-8171-485a-bd00-c1d13df89d98 req-e90655d3-b84f-4b3b-84e7-d4bcc4a2084e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032223 Jul 21 10:54:14.092553 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 464/939] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 21 10:54:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:54:14.435474 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-974b9b3e-ca3f-4f53-a138-9d86033ae854 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:54:14.446737 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-974b9b3e-ca3f-4f53-a138-9d86033ae854 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] [instance: dd3e9cc4-2396-4388-a748-85fe1055d4c7] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:54:14.453022 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-974b9b3e-ca3f-4f53-a138-9d86033ae854 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:14.453696 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-974b9b3e-ca3f-4f53-a138-9d86033ae854 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:14.454662 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-974b9b3e-ca3f-4f53-a138-9d86033ae854 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:14.455543 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-974b9b3e-ca3f-4f53-a138-9d86033ae854 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:14.597898 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-974b9b3e-ca3f-4f53-a138-9d86033ae854 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d04261c643948c0b7d9a20579c52dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f5f72a0f2054b89bb61968a2de9f10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:54:14.605889 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-974b9b3e-ca3f-4f53-a138-9d86033ae854 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3e9cc4-2396-4388-a748-85fe1055d4c7" status: 200 len: 1314 microversion: 2.1 time: 0.175415 Jul 21 10:54:14.614002 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 476/940] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:54:14 2022] GET /compute/v2.1/servers/dd3e9cc4-2396-4388-a748-85fe1055d4c7 => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:54:14.790818 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-908884ac-ca9c-4de6-8c90-012e0d880acb tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:54:14.799239 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-908884ac-ca9c-4de6-8c90-012e0d880acb tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 68c9ec60-9f75-4491-a780-6c339cc6d445] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:54:14.818491 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-908884ac-ca9c-4de6-8c90-012e0d880acb tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:14.819328 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-908884ac-ca9c-4de6-8c90-012e0d880acb tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:14.820354 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-908884ac-ca9c-4de6-8c90-012e0d880acb tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:14.821133 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-908884ac-ca9c-4de6-8c90-012e0d880acb tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:14.928815 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-908884ac-ca9c-4de6-8c90-012e0d880acb tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:54:14.940533 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-908884ac-ca9c-4de6-8c90-012e0d880acb tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:54:14.942176 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-908884ac-ca9c-4de6-8c90-012e0d880acb tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '23b63d44bb304e97a38acc6d0b791c95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c1b9c9f7024f8494e0a9b58fe35710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:54:14.944070 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-908884ac-ca9c-4de6-8c90-012e0d880acb tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445" status: 200 len: 1365 microversion: 2.20 time: 0.158538 Jul 21 10:54:14.947627 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 465/941] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:54:14 2022] GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445 => generated 1365 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 10:54:15.623452 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-741c4a05-438f-4864-9f84-b9471e95cd4a tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:54:15.624049 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-741c4a05-438f-4864-9f84-b9471e95cd4a tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] [instance: dd3e9cc4-2396-4388-a748-85fe1055d4c7] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:54:15.633270 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-741c4a05-438f-4864-9f84-b9471e95cd4a tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:15.633731 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-741c4a05-438f-4864-9f84-b9471e95cd4a tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:15.634558 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-741c4a05-438f-4864-9f84-b9471e95cd4a tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:15.635009 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-741c4a05-438f-4864-9f84-b9471e95cd4a tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:15.776613 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-741c4a05-438f-4864-9f84-b9471e95cd4a tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d04261c643948c0b7d9a20579c52dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f5f72a0f2054b89bb61968a2de9f10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:54:15.784103 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-741c4a05-438f-4864-9f84-b9471e95cd4a tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3e9cc4-2396-4388-a748-85fe1055d4c7" status: 200 len: 1314 microversion: 2.1 time: 0.165395 Jul 21 10:54:15.784667 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 477/942] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:54:15 2022] GET /compute/v2.1/servers/dd3e9cc4-2396-4388-a748-85fe1055d4c7 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:54:15.965208 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-992d29e0-2051-4c47-b602-e7da6c7632c8 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:54:15.965813 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-992d29e0-2051-4c47-b602-e7da6c7632c8 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 68c9ec60-9f75-4491-a780-6c339cc6d445] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:54:15.972298 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-992d29e0-2051-4c47-b602-e7da6c7632c8 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:15.972738 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-992d29e0-2051-4c47-b602-e7da6c7632c8 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:15.973482 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-992d29e0-2051-4c47-b602-e7da6c7632c8 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:15.974358 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-992d29e0-2051-4c47-b602-e7da6c7632c8 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:15.987256 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.wsgi [None req-992d29e0-2051-4c47-b602-e7da6c7632c8 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] HTTP exception thrown: Instance 68c9ec60-9f75-4491-a780-6c339cc6d445 could not be found. Jul 21 10:54:15.988877 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-992d29e0-2051-4c47-b602-e7da6c7632c8 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Request method failure captured: Jul 21 10:54:15.988877 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: request: GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445 HTTP/1.1 Jul 21 10:54:15.988877 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Accept: application/json Jul 21 10:54:15.988877 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Accept-Encoding: identity Jul 21 10:54:15.988877 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Connection: close Jul 21 10:54:15.988877 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Content-Length: 0 Jul 21 10:54:15.988877 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Content-Type: application/json Jul 21 10:54:15.988877 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Host: 10.222.0.48 Jul 21 10:54:15.988877 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Openstack-System-Scope: None Jul 21 10:54:15.988877 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: User-Agent: python-urllib3/1.26.9 Jul 21 10:54:15.988877 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Auth-Token: gAAAAABi2S6AAell6KnUKQJ3Lgu-3CQXwlXJQPgUDimqJdCH8j6KcSAoDWQyXvEJe0_atGC5pxRdTL4J2FORWXfIe4hdNevegn1welfv2n2eN9xTT3J5bH13TYDEfzY7soM01d6yrZE7vqG_CO_ZwO6uAl-F1pPUpF-cBO7OhNzzbDRpZN3MYPs Jul 21 10:54:15.988877 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Domain-Id: None Jul 21 10:54:15.988877 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Domain-Name: None Jul 21 10:54:15.988877 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Identity-Status: Confirmed Jul 21 10:54:15.988877 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Is-Admin-Project: True Jul 21 10:54:15.988877 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Openstack-Nova-Api-Version: 2.20 Jul 21 10:54:15.988877 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Domain-Id: default Jul 21 10:54:15.988877 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Domain-Name: Default Jul 21 10:54:15.988877 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Id: 29c1b9c9f7024f8494e0a9b58fe35710 Jul 21 10:54:15.988877 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-97716353 Jul 21 10:54:15.988877 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Role: reader,member Jul 21 10:54:15.988877 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Roles: reader,member Jul 21 10:54:15.991172 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/29c1b9c9f7024f8494e0a9b58fe35710"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/29c1b9c9f7024f8494e0a9b58fe35710"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/29c1b9c9f7024f8494e0a9b58fe35710"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_29c1b9c9f7024f8494e0a9b58fe35710"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] Jul 21 10:54:15.991172 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Tenant: tempest-AttachVolumeShelveTestJSON-97716353 Jul 21 10:54:15.991172 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Tenant-Id: 29c1b9c9f7024f8494e0a9b58fe35710 Jul 21 10:54:15.991172 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-97716353 Jul 21 10:54:15.991172 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User: tempest-AttachVolumeShelveTestJSON-97716353-project Jul 21 10:54:15.991172 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Domain-Id: default Jul 21 10:54:15.991172 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Domain-Name: Default Jul 21 10:54:15.991172 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Id: 23b63d44bb304e97a38acc6d0b791c95 Jul 21 10:54:15.991172 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Name: tempest-AttachVolumeShelveTestJSON-97716353-project Jul 21 10:54:15.991172 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: method: > Jul 21 10:54:15.991172 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: exception: Instance 68c9ec60-9f75-4491-a780-6c339cc6d445 could not be found. Jul 21 10:54:15.991172 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: action_args: {'id': '68c9ec60-9f75-4491-a780-6c339cc6d445'} Jul 21 10:54:15.992252 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 10:54:15.992252 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:54:15.992252 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 10:54:15.992252 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 10:54:15.992252 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 10:54:15.992252 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 10:54:15.992252 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 10:54:15.992252 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 10:54:15.992252 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 10:54:15.992252 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 10:54:15.992252 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68c9ec60-9f75-4491-a780-6c339cc6d445 could not be found. Jul 21 10:54:15.992252 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:54:15.992252 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:54:15.992252 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:54:15.992252 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:54:15.992252 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:54:15.992252 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:54:15.992252 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 10:54:15.992252 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 10:54:15.992252 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 10:54:15.993898 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 10:54:15.993898 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 10:54:15.993898 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 10:54:15.993898 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 10:54:15.993898 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 10:54:15.993898 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 10:54:15.993898 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 10:54:15.993898 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68c9ec60-9f75-4491-a780-6c339cc6d445 could not be found. Jul 21 10:54:15.993898 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:54:15.993898 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:54:15.993898 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:54:15.993898 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:54:15.993898 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:54:15.993898 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:54:15.993898 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 10:54:15.993898 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 10:54:15.993898 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68c9ec60-9f75-4491-a780-6c339cc6d445 could not be found. Jul 21 10:54:15.993898 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:54:15.995273 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-992d29e0-2051-4c47-b602-e7da6c7632c8 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Returning 404 to user: Instance 68c9ec60-9f75-4491-a780-6c339cc6d445 could not be found. {{(pid=124868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 10:54:15.995273 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-992d29e0-2051-4c47-b602-e7da6c7632c8 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445" status: 404 len: 111 microversion: 2.20 time: 0.030315 Jul 21 10:54:15.995273 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 466/943] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:54:15 2022] GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 21 10:54:16.000023 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-496a2148-5091-461f-9764-9c0211eef494 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '.version_select at 0x7f795ea7be50>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:54:16.085354 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-496a2148-5091-461f-9764-9c0211eef494 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-871932054" status: 204 len: 0 microversion: 2.20 time: 0.088993 Jul 21 10:54:16.085917 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 478/944] 10.222.0.48 () {60 vars in 1258 bytes} [Thu Jul 21 10:54:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-871932054 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 21 10:54:16.811483 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-a6c4f123-7e76-4ccb-9383-ff0e5978fb6b tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:54:16.811483 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-a6c4f123-7e76-4ccb-9383-ff0e5978fb6b tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] [instance: dd3e9cc4-2396-4388-a748-85fe1055d4c7] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:54:16.814407 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a6c4f123-7e76-4ccb-9383-ff0e5978fb6b tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:16.814972 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a6c4f123-7e76-4ccb-9383-ff0e5978fb6b tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:16.815979 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a6c4f123-7e76-4ccb-9383-ff0e5978fb6b tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:16.816474 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a6c4f123-7e76-4ccb-9383-ff0e5978fb6b tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:16.971439 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-a6c4f123-7e76-4ccb-9383-ff0e5978fb6b tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d04261c643948c0b7d9a20579c52dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f5f72a0f2054b89bb61968a2de9f10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:54:16.979772 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-a6c4f123-7e76-4ccb-9383-ff0e5978fb6b tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3e9cc4-2396-4388-a748-85fe1055d4c7" status: 200 len: 1314 microversion: 2.1 time: 0.182361 Jul 21 10:54:16.980592 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 467/945] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:54:16 2022] GET /compute/v2.1/servers/dd3e9cc4-2396-4388-a748-85fe1055d4c7 => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:54:17.061926 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [req-1462b2d1-f94c-486e-bc5c-98003238854f req-0b4033fb-4469-4c30-923f-a8a62f8f419c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd3e9cc4-2396-4388-a748-85fe1055d4c7", "name": "network-vif-plugged", "status": "completed", "tag": "ac28d821-fded-4f58-b25c-ad117a60ed94"}]} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:54:17.073499 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-1462b2d1-f94c-486e-bc5c-98003238854f req-0b4033fb-4469-4c30-923f-a8a62f8f419c service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:17.073951 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-1462b2d1-f94c-486e-bc5c-98003238854f req-0b4033fb-4469-4c30-923f-a8a62f8f419c service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:17.084808 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.compute.server_external_events [req-1462b2d1-f94c-486e-bc5c-98003238854f req-0b4033fb-4469-4c30-923f-a8a62f8f419c service nova] Creating event network-vif-plugged:ac28d821-fded-4f58-b25c-ad117a60ed94 for instance dd3e9cc4-2396-4388-a748-85fe1055d4c7 on hv-cinder-84980 Jul 21 10:54:17.089840 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [req-1462b2d1-f94c-486e-bc5c-98003238854f req-0b4033fb-4469-4c30-923f-a8a62f8f419c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033359 Jul 21 10:54:17.090415 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 479/946] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 21 10:54:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:54:17.997059 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-54dba72c-2003-49a4-9849-e579ff33e843 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:54:17.997609 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-54dba72c-2003-49a4-9849-e579ff33e843 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] [instance: dd3e9cc4-2396-4388-a748-85fe1055d4c7] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:54:17.999555 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell0:SELECT=2 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:54:18.000349 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell0:SELECT=6 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:54:18.005826 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-54dba72c-2003-49a4-9849-e579ff33e843 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:18.006465 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-54dba72c-2003-49a4-9849-e579ff33e843 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:18.007242 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-54dba72c-2003-49a4-9849-e579ff33e843 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:18.007672 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-54dba72c-2003-49a4-9849-e579ff33e843 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:18.140773 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-54dba72c-2003-49a4-9849-e579ff33e843 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d04261c643948c0b7d9a20579c52dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f5f72a0f2054b89bb61968a2de9f10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:54:18.148635 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-54dba72c-2003-49a4-9849-e579ff33e843 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3e9cc4-2396-4388-a748-85fe1055d4c7" status: 200 len: 1314 microversion: 2.1 time: 0.155572 Jul 21 10:54:18.149195 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 468/947] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:54:17 2022] GET /compute/v2.1/servers/dd3e9cc4-2396-4388-a748-85fe1055d4c7 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:54:18.254858 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell0:SELECT=2 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:54:18.259450 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-f1ed8a16-43a5-4fe1-927c-dae659ef6eb4 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:54:18.260055 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-f1ed8a16-43a5-4fe1-927c-dae659ef6eb4 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 68c9ec60-9f75-4491-a780-6c339cc6d445] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:54:18.272330 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f1ed8a16-43a5-4fe1-927c-dae659ef6eb4 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:18.272330 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f1ed8a16-43a5-4fe1-927c-dae659ef6eb4 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:18.272330 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f1ed8a16-43a5-4fe1-927c-dae659ef6eb4 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:18.272330 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f1ed8a16-43a5-4fe1-927c-dae659ef6eb4 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:18.283706 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.wsgi [None req-f1ed8a16-43a5-4fe1-927c-dae659ef6eb4 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] HTTP exception thrown: Instance 68c9ec60-9f75-4491-a780-6c339cc6d445 could not be found. Jul 21 10:54:18.285555 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-f1ed8a16-43a5-4fe1-927c-dae659ef6eb4 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Request method failure captured: Jul 21 10:54:18.285555 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: request: DELETE /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445 HTTP/1.1 Jul 21 10:54:18.285555 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Accept: application/json Jul 21 10:54:18.285555 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Accept-Encoding: identity Jul 21 10:54:18.285555 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Connection: close Jul 21 10:54:18.285555 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Content-Length: 0 Jul 21 10:54:18.285555 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Content-Type: application/json Jul 21 10:54:18.285555 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Host: 10.222.0.48 Jul 21 10:54:18.285555 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Openstack-System-Scope: None Jul 21 10:54:18.285555 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: User-Agent: python-urllib3/1.26.9 Jul 21 10:54:18.285555 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Auth-Token: gAAAAABi2S6AAell6KnUKQJ3Lgu-3CQXwlXJQPgUDimqJdCH8j6KcSAoDWQyXvEJe0_atGC5pxRdTL4J2FORWXfIe4hdNevegn1welfv2n2eN9xTT3J5bH13TYDEfzY7soM01d6yrZE7vqG_CO_ZwO6uAl-F1pPUpF-cBO7OhNzzbDRpZN3MYPs Jul 21 10:54:18.285555 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Domain-Id: None Jul 21 10:54:18.285555 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Domain-Name: None Jul 21 10:54:18.285555 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Identity-Status: Confirmed Jul 21 10:54:18.285555 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Is-Admin-Project: True Jul 21 10:54:18.285555 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Openstack-Nova-Api-Version: 2.20 Jul 21 10:54:18.285555 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Project-Domain-Id: default Jul 21 10:54:18.285555 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Project-Domain-Name: Default Jul 21 10:54:18.285555 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Project-Id: 29c1b9c9f7024f8494e0a9b58fe35710 Jul 21 10:54:18.285555 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-97716353 Jul 21 10:54:18.285555 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Role: reader,member Jul 21 10:54:18.285555 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Roles: reader,member Jul 21 10:54:18.288280 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/29c1b9c9f7024f8494e0a9b58fe35710"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/29c1b9c9f7024f8494e0a9b58fe35710"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/29c1b9c9f7024f8494e0a9b58fe35710"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_29c1b9c9f7024f8494e0a9b58fe35710"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] Jul 21 10:54:18.288280 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Tenant: tempest-AttachVolumeShelveTestJSON-97716353 Jul 21 10:54:18.288280 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Tenant-Id: 29c1b9c9f7024f8494e0a9b58fe35710 Jul 21 10:54:18.288280 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-97716353 Jul 21 10:54:18.288280 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User: tempest-AttachVolumeShelveTestJSON-97716353-project Jul 21 10:54:18.288280 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User-Domain-Id: default Jul 21 10:54:18.288280 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User-Domain-Name: Default Jul 21 10:54:18.288280 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User-Id: 23b63d44bb304e97a38acc6d0b791c95 Jul 21 10:54:18.288280 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User-Name: tempest-AttachVolumeShelveTestJSON-97716353-project Jul 21 10:54:18.288280 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: method: > Jul 21 10:54:18.288280 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: exception: Instance 68c9ec60-9f75-4491-a780-6c339cc6d445 could not be found. Jul 21 10:54:18.288280 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: action_args: {'id': '68c9ec60-9f75-4491-a780-6c339cc6d445'} Jul 21 10:54:18.289448 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 10:54:18.289448 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:54:18.289448 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 10:54:18.289448 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 10:54:18.289448 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 10:54:18.289448 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 10:54:18.289448 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 10:54:18.289448 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 10:54:18.289448 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 10:54:18.289448 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 10:54:18.289448 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68c9ec60-9f75-4491-a780-6c339cc6d445 could not be found. Jul 21 10:54:18.289448 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:54:18.289448 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:54:18.289448 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:54:18.289448 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:54:18.289448 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:54:18.289448 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:54:18.289448 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 10:54:18.289448 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 10:54:18.289448 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 10:54:18.291011 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 10:54:18.291011 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 21 10:54:18.291011 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 21 10:54:18.291011 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 21 10:54:18.291011 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 21 10:54:18.291011 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 10:54:18.291011 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 10:54:18.291011 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 10:54:18.291011 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 10:54:18.291011 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68c9ec60-9f75-4491-a780-6c339cc6d445 could not be found. Jul 21 10:54:18.291011 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:54:18.291011 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:54:18.291011 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:54:18.291011 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:54:18.291011 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:54:18.291011 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:54:18.291011 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 10:54:18.291011 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 10:54:18.291011 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68c9ec60-9f75-4491-a780-6c339cc6d445 could not be found. Jul 21 10:54:18.291011 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:54:18.293171 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-f1ed8a16-43a5-4fe1-927c-dae659ef6eb4 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Returning 404 to user: Instance 68c9ec60-9f75-4491-a780-6c339cc6d445 could not be found. {{(pid=124867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 10:54:18.293171 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-f1ed8a16-43a5-4fe1-927c-dae659ef6eb4 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "DELETE /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445" status: 404 len: 111 microversion: 2.20 time: 0.039878 Jul 21 10:54:18.293171 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 480/948] 10.222.0.48 () {60 vars in 1279 bytes} [Thu Jul 21 10:54:18 2022] DELETE /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 21 10:54:18.296821 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-df0d5921-b655-43f9-a586-c3fe860bdd11 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:54:18.297431 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-df0d5921-b655-43f9-a586-c3fe860bdd11 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 68c9ec60-9f75-4491-a780-6c339cc6d445] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:54:18.303554 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-df0d5921-b655-43f9-a586-c3fe860bdd11 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:18.304015 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-df0d5921-b655-43f9-a586-c3fe860bdd11 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:18.304776 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-df0d5921-b655-43f9-a586-c3fe860bdd11 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:18.305209 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-df0d5921-b655-43f9-a586-c3fe860bdd11 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:18.318654 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.wsgi [None req-df0d5921-b655-43f9-a586-c3fe860bdd11 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] HTTP exception thrown: Instance 68c9ec60-9f75-4491-a780-6c339cc6d445 could not be found. Jul 21 10:54:18.320180 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-df0d5921-b655-43f9-a586-c3fe860bdd11 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Request method failure captured: Jul 21 10:54:18.320180 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: request: GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445 HTTP/1.1 Jul 21 10:54:18.320180 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Accept: application/json Jul 21 10:54:18.320180 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Accept-Encoding: identity Jul 21 10:54:18.320180 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Connection: close Jul 21 10:54:18.320180 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Content-Length: 0 Jul 21 10:54:18.320180 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Content-Type: application/json Jul 21 10:54:18.320180 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Host: 10.222.0.48 Jul 21 10:54:18.320180 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Openstack-System-Scope: None Jul 21 10:54:18.320180 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: User-Agent: python-urllib3/1.26.9 Jul 21 10:54:18.320180 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Auth-Token: gAAAAABi2S6AAell6KnUKQJ3Lgu-3CQXwlXJQPgUDimqJdCH8j6KcSAoDWQyXvEJe0_atGC5pxRdTL4J2FORWXfIe4hdNevegn1welfv2n2eN9xTT3J5bH13TYDEfzY7soM01d6yrZE7vqG_CO_ZwO6uAl-F1pPUpF-cBO7OhNzzbDRpZN3MYPs Jul 21 10:54:18.320180 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Domain-Id: None Jul 21 10:54:18.320180 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Domain-Name: None Jul 21 10:54:18.320180 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Identity-Status: Confirmed Jul 21 10:54:18.320180 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Is-Admin-Project: True Jul 21 10:54:18.320180 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Openstack-Nova-Api-Version: 2.20 Jul 21 10:54:18.320180 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Domain-Id: default Jul 21 10:54:18.320180 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Domain-Name: Default Jul 21 10:54:18.320180 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Id: 29c1b9c9f7024f8494e0a9b58fe35710 Jul 21 10:54:18.320180 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-97716353 Jul 21 10:54:18.320180 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Role: reader,member Jul 21 10:54:18.320180 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Roles: reader,member Jul 21 10:54:18.321867 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/29c1b9c9f7024f8494e0a9b58fe35710"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/29c1b9c9f7024f8494e0a9b58fe35710"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/29c1b9c9f7024f8494e0a9b58fe35710"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_29c1b9c9f7024f8494e0a9b58fe35710"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] Jul 21 10:54:18.321867 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Tenant: tempest-AttachVolumeShelveTestJSON-97716353 Jul 21 10:54:18.321867 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Tenant-Id: 29c1b9c9f7024f8494e0a9b58fe35710 Jul 21 10:54:18.321867 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-97716353 Jul 21 10:54:18.321867 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User: tempest-AttachVolumeShelveTestJSON-97716353-project Jul 21 10:54:18.321867 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Domain-Id: default Jul 21 10:54:18.321867 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Domain-Name: Default Jul 21 10:54:18.321867 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Id: 23b63d44bb304e97a38acc6d0b791c95 Jul 21 10:54:18.321867 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Name: tempest-AttachVolumeShelveTestJSON-97716353-project Jul 21 10:54:18.321867 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: method: > Jul 21 10:54:18.321867 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: exception: Instance 68c9ec60-9f75-4491-a780-6c339cc6d445 could not be found. Jul 21 10:54:18.321867 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: action_args: {'id': '68c9ec60-9f75-4491-a780-6c339cc6d445'} Jul 21 10:54:18.322784 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 10:54:18.322784 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:54:18.322784 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 10:54:18.322784 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 10:54:18.322784 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 10:54:18.322784 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 10:54:18.322784 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 10:54:18.322784 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 10:54:18.322784 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 10:54:18.322784 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 10:54:18.322784 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68c9ec60-9f75-4491-a780-6c339cc6d445 could not be found. Jul 21 10:54:18.322784 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:54:18.322784 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:54:18.322784 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:54:18.322784 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:54:18.322784 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:54:18.322784 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:54:18.322784 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 10:54:18.322784 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 10:54:18.322784 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 10:54:18.324265 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 10:54:18.324265 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 10:54:18.324265 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 10:54:18.324265 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 10:54:18.324265 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 10:54:18.324265 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 10:54:18.324265 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 10:54:18.324265 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68c9ec60-9f75-4491-a780-6c339cc6d445 could not be found. Jul 21 10:54:18.324265 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:54:18.324265 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:54:18.324265 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:54:18.324265 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:54:18.324265 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:54:18.324265 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:54:18.324265 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 10:54:18.324265 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 10:54:18.324265 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68c9ec60-9f75-4491-a780-6c339cc6d445 could not be found. Jul 21 10:54:18.324265 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:54:18.325493 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-df0d5921-b655-43f9-a586-c3fe860bdd11 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Returning 404 to user: Instance 68c9ec60-9f75-4491-a780-6c339cc6d445 could not be found. {{(pid=124868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 10:54:18.325493 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-df0d5921-b655-43f9-a586-c3fe860bdd11 tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445" status: 404 len: 111 microversion: 2.20 time: 0.029036 Jul 21 10:54:18.325493 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 469/949] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:54:18 2022] GET /compute/v2.1/servers/68c9ec60-9f75-4491-a780-6c339cc6d445 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 21 10:54:19.171176 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-26377b71-1819-4fe9-9b5e-37c4d0f6268a tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:54:19.171668 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-26377b71-1819-4fe9-9b5e-37c4d0f6268a tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] [instance: dd3e9cc4-2396-4388-a748-85fe1055d4c7] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:54:19.179995 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-26377b71-1819-4fe9-9b5e-37c4d0f6268a tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:19.180503 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-26377b71-1819-4fe9-9b5e-37c4d0f6268a tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:19.181298 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-26377b71-1819-4fe9-9b5e-37c4d0f6268a tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:19.181735 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-26377b71-1819-4fe9-9b5e-37c4d0f6268a tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:19.320292 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-26377b71-1819-4fe9-9b5e-37c4d0f6268a tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d04261c643948c0b7d9a20579c52dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f5f72a0f2054b89bb61968a2de9f10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:54:19.327716 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-26377b71-1819-4fe9-9b5e-37c4d0f6268a tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3e9cc4-2396-4388-a748-85fe1055d4c7" status: 200 len: 1314 microversion: 2.1 time: 0.161008 Jul 21 10:54:19.328270 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 481/950] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:54:19 2022] GET /compute/v2.1/servers/dd3e9cc4-2396-4388-a748-85fe1055d4c7 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:54:19.603728 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-7d41ab30-000f-4b74-b562-e596b026317b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:54:19.615668 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-7d41ab30-000f-4b74-b562-e596b026317b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:54:19.615668 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7d41ab30-000f-4b74-b562-e596b026317b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:19.615668 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7d41ab30-000f-4b74-b562-e596b026317b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:19.615668 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7d41ab30-000f-4b74-b562-e596b026317b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:19.616301 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7d41ab30-000f-4b74-b562-e596b026317b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:19.628267 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.wsgi [None req-7d41ab30-000f-4b74-b562-e596b026317b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] HTTP exception thrown: Instance 1e730525-7ce4-4a5a-8023-84cae6b1da3d could not be found. Jul 21 10:54:19.629933 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-7d41ab30-000f-4b74-b562-e596b026317b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Request method failure captured: Jul 21 10:54:19.629933 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: request: DELETE /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d HTTP/1.1 Jul 21 10:54:19.629933 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Accept: application/json Jul 21 10:54:19.629933 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Accept-Encoding: identity Jul 21 10:54:19.629933 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Connection: close Jul 21 10:54:19.629933 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Content-Length: 0 Jul 21 10:54:19.629933 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Content-Type: application/json Jul 21 10:54:19.629933 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Host: 10.222.0.48 Jul 21 10:54:19.629933 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Openstack-System-Scope: None Jul 21 10:54:19.629933 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: User-Agent: python-urllib3/1.26.9 Jul 21 10:54:19.629933 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Auth-Token: gAAAAABi2S6AAell6KnUKQJ3Lgu-3CQXwlXJQPgUDimqJdCH8j6KcSAoDWQyXvEJe0_atGC5pxRdTL4J2FORWXfIe4hdNevegn1welfv2n2eN9xTT3J5bH13TYDEfzY7soM01d6yrZE7vqG_CO_ZwO6uAl-F1pPUpF-cBO7OhNzzbDRpZN3MYPs Jul 21 10:54:19.629933 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Domain-Id: None Jul 21 10:54:19.629933 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Domain-Name: None Jul 21 10:54:19.629933 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Identity-Status: Confirmed Jul 21 10:54:19.629933 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Is-Admin-Project: True Jul 21 10:54:19.629933 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Openstack-Nova-Api-Version: 2.20 Jul 21 10:54:19.629933 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Domain-Id: default Jul 21 10:54:19.629933 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Domain-Name: Default Jul 21 10:54:19.629933 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Id: 29c1b9c9f7024f8494e0a9b58fe35710 Jul 21 10:54:19.629933 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-97716353 Jul 21 10:54:19.629933 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Role: reader,member Jul 21 10:54:19.629933 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Roles: reader,member Jul 21 10:54:19.632469 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/29c1b9c9f7024f8494e0a9b58fe35710"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/29c1b9c9f7024f8494e0a9b58fe35710"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/29c1b9c9f7024f8494e0a9b58fe35710"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_29c1b9c9f7024f8494e0a9b58fe35710"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] Jul 21 10:54:19.632469 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Tenant: tempest-AttachVolumeShelveTestJSON-97716353 Jul 21 10:54:19.632469 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Tenant-Id: 29c1b9c9f7024f8494e0a9b58fe35710 Jul 21 10:54:19.632469 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-97716353 Jul 21 10:54:19.632469 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User: tempest-AttachVolumeShelveTestJSON-97716353-project Jul 21 10:54:19.632469 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Domain-Id: default Jul 21 10:54:19.632469 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Domain-Name: Default Jul 21 10:54:19.632469 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Id: 23b63d44bb304e97a38acc6d0b791c95 Jul 21 10:54:19.632469 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Name: tempest-AttachVolumeShelveTestJSON-97716353-project Jul 21 10:54:19.632469 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: method: > Jul 21 10:54:19.632469 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: exception: Instance 1e730525-7ce4-4a5a-8023-84cae6b1da3d could not be found. Jul 21 10:54:19.632469 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: action_args: {'id': '1e730525-7ce4-4a5a-8023-84cae6b1da3d'} Jul 21 10:54:19.633340 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 10:54:19.633340 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:54:19.633340 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 10:54:19.633340 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 10:54:19.633340 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 10:54:19.633340 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 10:54:19.633340 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 10:54:19.633340 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 10:54:19.633340 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 10:54:19.633340 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 10:54:19.633340 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e730525-7ce4-4a5a-8023-84cae6b1da3d could not be found. Jul 21 10:54:19.633340 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:54:19.633340 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:54:19.633340 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:54:19.633340 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:54:19.633340 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:54:19.633340 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:54:19.633340 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 10:54:19.633340 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 10:54:19.633340 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 10:54:19.634942 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 10:54:19.634942 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 21 10:54:19.634942 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 21 10:54:19.634942 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 21 10:54:19.634942 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 21 10:54:19.634942 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 10:54:19.634942 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 10:54:19.634942 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 10:54:19.634942 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 10:54:19.634942 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e730525-7ce4-4a5a-8023-84cae6b1da3d could not be found. Jul 21 10:54:19.634942 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:54:19.634942 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:54:19.634942 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:54:19.634942 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:54:19.634942 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:54:19.634942 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:54:19.634942 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 10:54:19.634942 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 10:54:19.634942 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e730525-7ce4-4a5a-8023-84cae6b1da3d could not be found. Jul 21 10:54:19.634942 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:54:19.636383 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-7d41ab30-000f-4b74-b562-e596b026317b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Returning 404 to user: Instance 1e730525-7ce4-4a5a-8023-84cae6b1da3d could not be found. {{(pid=124868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 10:54:19.636383 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-7d41ab30-000f-4b74-b562-e596b026317b tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "DELETE /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 404 len: 111 microversion: 2.20 time: 0.037460 Jul 21 10:54:19.636383 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 470/951] 10.222.0.48 () {60 vars in 1279 bytes} [Thu Jul 21 10:54:19 2022] DELETE /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 21 10:54:19.640954 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-29591789-e742-41b7-b5e2-0e8cbaa7acec tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:54:19.641563 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-29591789-e742-41b7-b5e2-0e8cbaa7acec tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] [instance: 1e730525-7ce4-4a5a-8023-84cae6b1da3d] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:54:19.647796 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-29591789-e742-41b7-b5e2-0e8cbaa7acec tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:19.648244 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-29591789-e742-41b7-b5e2-0e8cbaa7acec tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:19.649002 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-29591789-e742-41b7-b5e2-0e8cbaa7acec tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:19.649439 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-29591789-e742-41b7-b5e2-0e8cbaa7acec tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:19.664306 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.wsgi [None req-29591789-e742-41b7-b5e2-0e8cbaa7acec tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] HTTP exception thrown: Instance 1e730525-7ce4-4a5a-8023-84cae6b1da3d could not be found. Jul 21 10:54:19.665830 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-29591789-e742-41b7-b5e2-0e8cbaa7acec tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Request method failure captured: Jul 21 10:54:19.665830 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: request: GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d HTTP/1.1 Jul 21 10:54:19.665830 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Accept: application/json Jul 21 10:54:19.665830 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Accept-Encoding: identity Jul 21 10:54:19.665830 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Connection: close Jul 21 10:54:19.665830 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Content-Length: 0 Jul 21 10:54:19.665830 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Content-Type: application/json Jul 21 10:54:19.665830 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Host: 10.222.0.48 Jul 21 10:54:19.665830 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Openstack-System-Scope: None Jul 21 10:54:19.665830 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: User-Agent: python-urllib3/1.26.9 Jul 21 10:54:19.665830 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Auth-Token: gAAAAABi2S6AAell6KnUKQJ3Lgu-3CQXwlXJQPgUDimqJdCH8j6KcSAoDWQyXvEJe0_atGC5pxRdTL4J2FORWXfIe4hdNevegn1welfv2n2eN9xTT3J5bH13TYDEfzY7soM01d6yrZE7vqG_CO_ZwO6uAl-F1pPUpF-cBO7OhNzzbDRpZN3MYPs Jul 21 10:54:19.665830 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Domain-Id: None Jul 21 10:54:19.665830 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Domain-Name: None Jul 21 10:54:19.665830 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Identity-Status: Confirmed Jul 21 10:54:19.665830 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Is-Admin-Project: True Jul 21 10:54:19.665830 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Openstack-Nova-Api-Version: 2.20 Jul 21 10:54:19.665830 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Project-Domain-Id: default Jul 21 10:54:19.665830 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Project-Domain-Name: Default Jul 21 10:54:19.665830 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Project-Id: 29c1b9c9f7024f8494e0a9b58fe35710 Jul 21 10:54:19.665830 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-97716353 Jul 21 10:54:19.665830 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Role: reader,member Jul 21 10:54:19.665830 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Roles: reader,member Jul 21 10:54:19.667507 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/29c1b9c9f7024f8494e0a9b58fe35710"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/29c1b9c9f7024f8494e0a9b58fe35710"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/29c1b9c9f7024f8494e0a9b58fe35710"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_29c1b9c9f7024f8494e0a9b58fe35710"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] Jul 21 10:54:19.667507 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Tenant: tempest-AttachVolumeShelveTestJSON-97716353 Jul 21 10:54:19.667507 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Tenant-Id: 29c1b9c9f7024f8494e0a9b58fe35710 Jul 21 10:54:19.667507 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-97716353 Jul 21 10:54:19.667507 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User: tempest-AttachVolumeShelveTestJSON-97716353-project Jul 21 10:54:19.667507 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User-Domain-Id: default Jul 21 10:54:19.667507 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User-Domain-Name: Default Jul 21 10:54:19.667507 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User-Id: 23b63d44bb304e97a38acc6d0b791c95 Jul 21 10:54:19.667507 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User-Name: tempest-AttachVolumeShelveTestJSON-97716353-project Jul 21 10:54:19.667507 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: method: > Jul 21 10:54:19.667507 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: exception: Instance 1e730525-7ce4-4a5a-8023-84cae6b1da3d could not be found. Jul 21 10:54:19.667507 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: action_args: {'id': '1e730525-7ce4-4a5a-8023-84cae6b1da3d'} Jul 21 10:54:19.668340 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 10:54:19.668340 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:54:19.668340 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 10:54:19.668340 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 10:54:19.668340 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 10:54:19.668340 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 10:54:19.668340 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 10:54:19.668340 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 10:54:19.668340 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 10:54:19.668340 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 10:54:19.668340 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e730525-7ce4-4a5a-8023-84cae6b1da3d could not be found. Jul 21 10:54:19.668340 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:54:19.668340 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:54:19.668340 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:54:19.668340 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:54:19.668340 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:54:19.668340 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:54:19.668340 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 10:54:19.668340 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 10:54:19.668340 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 10:54:19.669515 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 10:54:19.669515 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 10:54:19.669515 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 10:54:19.669515 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 10:54:19.669515 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 10:54:19.669515 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 10:54:19.669515 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 10:54:19.669515 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e730525-7ce4-4a5a-8023-84cae6b1da3d could not be found. Jul 21 10:54:19.669515 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:54:19.669515 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:54:19.669515 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:54:19.669515 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:54:19.669515 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:54:19.669515 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:54:19.669515 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 10:54:19.669515 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 10:54:19.669515 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e730525-7ce4-4a5a-8023-84cae6b1da3d could not be found. Jul 21 10:54:19.669515 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:54:19.670675 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-29591789-e742-41b7-b5e2-0e8cbaa7acec tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] Returning 404 to user: Instance 1e730525-7ce4-4a5a-8023-84cae6b1da3d could not be found. {{(pid=124867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 10:54:19.670675 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-29591789-e742-41b7-b5e2-0e8cbaa7acec tempest-AttachVolumeShelveTestJSON-97716353 tempest-AttachVolumeShelveTestJSON-97716353-project] 10.222.0.48 "GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d" status: 404 len: 111 microversion: 2.20 time: 0.030220 Jul 21 10:54:19.670675 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 482/952] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jul 21 10:54:19 2022] GET /compute/v2.1/servers/1e730525-7ce4-4a5a-8023-84cae6b1da3d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 21 10:54:20.345295 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-df3ff2b5-ab46-4da4-8406-aad6d1a7b06f tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:54:20.346006 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-df3ff2b5-ab46-4da4-8406-aad6d1a7b06f tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] [instance: dd3e9cc4-2396-4388-a748-85fe1055d4c7] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:54:20.352601 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-df3ff2b5-ab46-4da4-8406-aad6d1a7b06f tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:20.353127 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-df3ff2b5-ab46-4da4-8406-aad6d1a7b06f tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:20.353902 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-df3ff2b5-ab46-4da4-8406-aad6d1a7b06f tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:20.354342 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-df3ff2b5-ab46-4da4-8406-aad6d1a7b06f tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:20.489687 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-df3ff2b5-ab46-4da4-8406-aad6d1a7b06f tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d04261c643948c0b7d9a20579c52dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f5f72a0f2054b89bb61968a2de9f10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:54:20.497193 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-df3ff2b5-ab46-4da4-8406-aad6d1a7b06f tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3e9cc4-2396-4388-a748-85fe1055d4c7" status: 200 len: 1498 microversion: 2.1 time: 0.155824 Jul 21 10:54:20.497767 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 471/953] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:54:20 2022] GET /compute/v2.1/servers/dd3e9cc4-2396-4388-a748-85fe1055d4c7 => generated 1498 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:54:21.465221 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-fd935c06-30ba-4766-8926-a2b19eb3eaaa tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:54:21.465837 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-fd935c06-30ba-4766-8926-a2b19eb3eaaa tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] [instance: dd3e9cc4-2396-4388-a748-85fe1055d4c7] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:54:21.473166 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fd935c06-30ba-4766-8926-a2b19eb3eaaa tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:21.475008 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fd935c06-30ba-4766-8926-a2b19eb3eaaa tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:21.475494 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fd935c06-30ba-4766-8926-a2b19eb3eaaa tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:21.475994 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fd935c06-30ba-4766-8926-a2b19eb3eaaa tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:21.513143 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-fd935c06-30ba-4766-8926-a2b19eb3eaaa tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] [instance: dd3e9cc4-2396-4388-a748-85fe1055d4c7] Going to try to terminate instance {{(pid=124867) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 10:54:21.822848 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-fd935c06-30ba-4766-8926-a2b19eb3eaaa tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] 10.222.0.48 "DELETE /compute/v2.1/servers/dd3e9cc4-2396-4388-a748-85fe1055d4c7" status: 204 len: 0 microversion: 2.1 time: 0.364368 Jul 21 10:54:21.823448 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 483/954] 10.222.0.48 () {58 vars in 1238 bytes} [Thu Jul 21 10:54:21 2022] DELETE /compute/v2.1/servers/dd3e9cc4-2396-4388-a748-85fe1055d4c7 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 21 10:54:21.831960 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-26e52480-36ec-45d4-9259-6a9fd54d12c6 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:54:21.832553 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-26e52480-36ec-45d4-9259-6a9fd54d12c6 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] [instance: dd3e9cc4-2396-4388-a748-85fe1055d4c7] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:54:21.844005 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-26e52480-36ec-45d4-9259-6a9fd54d12c6 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:21.844724 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-26e52480-36ec-45d4-9259-6a9fd54d12c6 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:21.851590 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-26e52480-36ec-45d4-9259-6a9fd54d12c6 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:21.851590 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-26e52480-36ec-45d4-9259-6a9fd54d12c6 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:22.005127 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-26e52480-36ec-45d4-9259-6a9fd54d12c6 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d04261c643948c0b7d9a20579c52dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f5f72a0f2054b89bb61968a2de9f10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:54:22.012876 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-26e52480-36ec-45d4-9259-6a9fd54d12c6 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3e9cc4-2396-4388-a748-85fe1055d4c7" status: 200 len: 1504 microversion: 2.1 time: 0.184847 Jul 21 10:54:22.013441 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 472/955] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:54:21 2022] GET /compute/v2.1/servers/dd3e9cc4-2396-4388-a748-85fe1055d4c7 => generated 1504 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:54:23.031944 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-57776db7-85ef-471f-af9b-1dee5768527a tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:54:23.033378 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-57776db7-85ef-471f-af9b-1dee5768527a tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] [instance: dd3e9cc4-2396-4388-a748-85fe1055d4c7] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:54:23.040087 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-57776db7-85ef-471f-af9b-1dee5768527a tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:23.040697 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-57776db7-85ef-471f-af9b-1dee5768527a tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:23.041482 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-57776db7-85ef-471f-af9b-1dee5768527a tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:23.041903 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-57776db7-85ef-471f-af9b-1dee5768527a tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:23.304947 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-57776db7-85ef-471f-af9b-1dee5768527a tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d04261c643948c0b7d9a20579c52dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f5f72a0f2054b89bb61968a2de9f10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:54:23.319955 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-57776db7-85ef-471f-af9b-1dee5768527a tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3e9cc4-2396-4388-a748-85fe1055d4c7" status: 200 len: 1504 microversion: 2.1 time: 0.285459 Jul 21 10:54:23.319955 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 484/956] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:54:23 2022] GET /compute/v2.1/servers/dd3e9cc4-2396-4388-a748-85fe1055d4c7 => generated 1504 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:54:24.110144 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [req-515f82ad-b05c-4528-8dd8-b39f94b51fc2 req-ecbdd662-2a4f-4e88-abed-868bb5df96fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd3e9cc4-2396-4388-a748-85fe1055d4c7", "name": "network-vif-deleted", "tag": "ac28d821-fded-4f58-b25c-ad117a60ed94"}]} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:54:24.122072 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-515f82ad-b05c-4528-8dd8-b39f94b51fc2 req-ecbdd662-2a4f-4e88-abed-868bb5df96fb service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:24.122607 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-515f82ad-b05c-4528-8dd8-b39f94b51fc2 req-ecbdd662-2a4f-4e88-abed-868bb5df96fb service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:24.137788 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.compute.server_external_events [req-515f82ad-b05c-4528-8dd8-b39f94b51fc2 req-ecbdd662-2a4f-4e88-abed-868bb5df96fb service nova] Creating event network-vif-deleted:ac28d821-fded-4f58-b25c-ad117a60ed94 for instance dd3e9cc4-2396-4388-a748-85fe1055d4c7 on hv-cinder-84980 Jul 21 10:54:24.152794 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [req-515f82ad-b05c-4528-8dd8-b39f94b51fc2 req-ecbdd662-2a4f-4e88-abed-868bb5df96fb service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046541 Jul 21 10:54:24.153699 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 473/957] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 21 10:54:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:54:24.331983 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-17b333df-32fc-4a7d-9528-b403b1d0249b tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:54:24.332649 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-17b333df-32fc-4a7d-9528-b403b1d0249b tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] [instance: dd3e9cc4-2396-4388-a748-85fe1055d4c7] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:54:24.340995 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-17b333df-32fc-4a7d-9528-b403b1d0249b tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:24.340995 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-17b333df-32fc-4a7d-9528-b403b1d0249b tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:24.341761 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-17b333df-32fc-4a7d-9528-b403b1d0249b tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:24.342265 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-17b333df-32fc-4a7d-9528-b403b1d0249b tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:24.413565 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-17b333df-32fc-4a7d-9528-b403b1d0249b tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d04261c643948c0b7d9a20579c52dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f5f72a0f2054b89bb61968a2de9f10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:54:24.421141 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-17b333df-32fc-4a7d-9528-b403b1d0249b tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3e9cc4-2396-4388-a748-85fe1055d4c7" status: 200 len: 1299 microversion: 2.1 time: 0.093676 Jul 21 10:54:24.421720 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 485/958] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:54:24 2022] GET /compute/v2.1/servers/dd3e9cc4-2396-4388-a748-85fe1055d4c7 => generated 1299 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:54:25.439787 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-8d1f619a-563a-43fd-b9e3-f89e6ba8ddc9 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:54:25.440338 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-8d1f619a-563a-43fd-b9e3-f89e6ba8ddc9 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] [instance: dd3e9cc4-2396-4388-a748-85fe1055d4c7] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:54:25.447759 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8d1f619a-563a-43fd-b9e3-f89e6ba8ddc9 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:25.448213 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8d1f619a-563a-43fd-b9e3-f89e6ba8ddc9 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:25.448979 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8d1f619a-563a-43fd-b9e3-f89e6ba8ddc9 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:25.449418 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8d1f619a-563a-43fd-b9e3-f89e6ba8ddc9 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:25.463358 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.wsgi [None req-8d1f619a-563a-43fd-b9e3-f89e6ba8ddc9 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] HTTP exception thrown: Instance dd3e9cc4-2396-4388-a748-85fe1055d4c7 could not be found. Jul 21 10:54:25.465028 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-8d1f619a-563a-43fd-b9e3-f89e6ba8ddc9 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Request method failure captured: Jul 21 10:54:25.465028 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: request: GET /compute/v2.1/servers/dd3e9cc4-2396-4388-a748-85fe1055d4c7 HTTP/1.1 Jul 21 10:54:25.465028 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Accept: application/json Jul 21 10:54:25.465028 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Accept-Encoding: identity Jul 21 10:54:25.465028 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Connection: close Jul 21 10:54:25.465028 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Content-Length: 0 Jul 21 10:54:25.465028 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Content-Type: application/json Jul 21 10:54:25.465028 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Host: 10.222.0.48 Jul 21 10:54:25.465028 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Openstack-System-Scope: None Jul 21 10:54:25.465028 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: User-Agent: python-urllib3/1.26.9 Jul 21 10:54:25.465028 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Auth-Token: gAAAAABi2TBNpWzdIdA7OJ7UdOd1Jej4w60y1Za-lT6rSvbLpunqiTctDBPHTU4-GHvdkGbQw1E70WlsCQRdYCTVUquAD4gduJZQBqrEc9wkq-vm6o4ZcmcQEblJWnWfYO4uDik-WqmInbw-uOapKAzDbfyzDc1fraNSJXjy7bfblNAKQnmb4Ow Jul 21 10:54:25.465028 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Domain-Id: None Jul 21 10:54:25.465028 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Domain-Name: None Jul 21 10:54:25.465028 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Identity-Status: Confirmed Jul 21 10:54:25.465028 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Is-Admin-Project: True Jul 21 10:54:25.465028 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Domain-Id: default Jul 21 10:54:25.465028 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Domain-Name: Default Jul 21 10:54:25.465028 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Id: 0f5f72a0f2054b89bb61968a2de9f10a Jul 21 10:54:25.465028 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Name: tempest-VolumesActionsTest-794086169 Jul 21 10:54:25.465028 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Role: reader,member Jul 21 10:54:25.465028 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Roles: reader,member Jul 21 10:54:25.466721 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0f5f72a0f2054b89bb61968a2de9f10a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0f5f72a0f2054b89bb61968a2de9f10a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0f5f72a0f2054b89bb61968a2de9f10a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0f5f72a0f2054b89bb61968a2de9f10a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] Jul 21 10:54:25.466721 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Tenant: tempest-VolumesActionsTest-794086169 Jul 21 10:54:25.466721 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Tenant-Id: 0f5f72a0f2054b89bb61968a2de9f10a Jul 21 10:54:25.466721 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Tenant-Name: tempest-VolumesActionsTest-794086169 Jul 21 10:54:25.466721 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User: tempest-VolumesActionsTest-794086169-project Jul 21 10:54:25.466721 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Domain-Id: default Jul 21 10:54:25.466721 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Domain-Name: Default Jul 21 10:54:25.466721 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Id: 1d04261c643948c0b7d9a20579c52dae Jul 21 10:54:25.466721 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Name: tempest-VolumesActionsTest-794086169-project Jul 21 10:54:25.466721 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: method: > Jul 21 10:54:25.466721 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: exception: Instance dd3e9cc4-2396-4388-a748-85fe1055d4c7 could not be found. Jul 21 10:54:25.466721 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: action_args: {'id': 'dd3e9cc4-2396-4388-a748-85fe1055d4c7'} Jul 21 10:54:25.467672 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 10:54:25.467672 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:54:25.467672 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 10:54:25.467672 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 10:54:25.467672 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 10:54:25.467672 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 10:54:25.467672 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 10:54:25.467672 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 10:54:25.467672 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 10:54:25.467672 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 10:54:25.467672 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd3e9cc4-2396-4388-a748-85fe1055d4c7 could not be found. Jul 21 10:54:25.467672 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:54:25.467672 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:54:25.467672 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:54:25.467672 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:54:25.467672 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:54:25.467672 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:54:25.467672 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 10:54:25.467672 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 10:54:25.467672 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 10:54:25.469198 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 10:54:25.469198 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 10:54:25.469198 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 10:54:25.469198 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 10:54:25.469198 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 10:54:25.469198 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 10:54:25.469198 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 10:54:25.469198 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd3e9cc4-2396-4388-a748-85fe1055d4c7 could not be found. Jul 21 10:54:25.469198 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:54:25.469198 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:54:25.469198 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:54:25.469198 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:54:25.469198 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:54:25.469198 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:54:25.469198 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 10:54:25.469198 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 10:54:25.469198 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd3e9cc4-2396-4388-a748-85fe1055d4c7 could not be found. Jul 21 10:54:25.469198 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:54:25.470495 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-8d1f619a-563a-43fd-b9e3-f89e6ba8ddc9 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Returning 404 to user: Instance dd3e9cc4-2396-4388-a748-85fe1055d4c7 could not be found. {{(pid=124868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 10:54:25.470495 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-8d1f619a-563a-43fd-b9e3-f89e6ba8ddc9 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3e9cc4-2396-4388-a748-85fe1055d4c7" status: 404 len: 111 microversion: 2.1 time: 0.031122 Jul 21 10:54:25.470495 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 474/959] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:54:25 2022] GET /compute/v2.1/servers/dd3e9cc4-2396-4388-a748-85fe1055d4c7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 10:54:25.573248 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-93c08449-b84b-45e9-b06a-de18f11a41a1 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-152763838", "imageRef": "282ddb30-fa0f-489d-9cc3-a3e70e03c631", "flavorRef": "452", "networks": [{"uuid": "8ceaccac-b641-4f35-9f06-627723dcabd5"}]}} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:54:25.629022 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.network.neutron [None req-93c08449-b84b-45e9-b06a-de18f11a41a1 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] validate_networks() for [('8ceaccac-b641-4f35-9f06-627723dcabd5', None, None, None, None, None)] {{(pid=124867) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 10:54:26.053279 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-93c08449-b84b-45e9-b06a-de18f11a41a1 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Flavor limits 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 10:54:26.053701 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-93c08449-b84b-45e9-b06a-de18f11a41a1 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Image limits 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 10:54:26.054167 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-93c08449-b84b-45e9-b06a-de18f11a41a1 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Flavor pref 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 10:54:26.054592 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-93c08449-b84b-45e9-b06a-de18f11a41a1 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Image pref 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 10:54:26.055002 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-93c08449-b84b-45e9-b06a-de18f11a41a1 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 10:54:26.063818 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-93c08449-b84b-45e9-b06a-de18f11a41a1 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:26.064286 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-93c08449-b84b-45e9-b06a-de18f11a41a1 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:26.065067 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-93c08449-b84b-45e9-b06a-de18f11a41a1 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:26.065494 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-93c08449-b84b-45e9-b06a-de18f11a41a1 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:26.082557 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.quota [None req-93c08449-b84b-45e9-b06a-de18f11a41a1 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Getting quotas for project 0f5f72a0f2054b89bb61968a2de9f10a. Resources: {'ram', 'instances', 'cores'} {{(pid=124867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 10:54:26.086983 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.quota [None req-93c08449-b84b-45e9-b06a-de18f11a41a1 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Getting quotas for user 1d04261c643948c0b7d9a20579c52dae and project 0f5f72a0f2054b89bb61968a2de9f10a. Resources: {'ram', 'instances', 'cores'} {{(pid=124867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 10:54:26.097920 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-93c08449-b84b-45e9-b06a-de18f11a41a1 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Going to run 1 instances... {{(pid=124867) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 10:54:26.100977 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-93c08449-b84b-45e9-b06a-de18f11a41a1 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] [instance: 17c50765-6f88-4ed0-85b2-6ca01ac3015b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='282ddb30-fa0f-489d-9cc3-a3e70e03c631',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124867) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 10:54:26.234245 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-93c08449-b84b-45e9-b06a-de18f11a41a1 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.664678 Jul 21 10:54:26.235303 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 486/960] 10.222.0.48 () {60 vars in 1146 bytes} [Thu Jul 21 10:54:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 666 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 10:54:26.246041 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-ab6068b7-8dec-4c9a-881a-4e4eae81dd46 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:54:26.246946 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-ab6068b7-8dec-4c9a-881a-4e4eae81dd46 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] [instance: 17c50765-6f88-4ed0-85b2-6ca01ac3015b] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:54:26.320120 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-ab6068b7-8dec-4c9a-881a-4e4eae81dd46 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d04261c643948c0b7d9a20579c52dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f5f72a0f2054b89bb61968a2de9f10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:54:26.324814 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-ab6068b7-8dec-4c9a-881a-4e4eae81dd46 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] 10.222.0.48 "GET /compute/v2.1/servers/17c50765-6f88-4ed0-85b2-6ca01ac3015b" status: 200 len: 1213 microversion: 2.1 time: 0.082628 Jul 21 10:54:26.325377 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 475/961] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:54:26 2022] GET /compute/v2.1/servers/17c50765-6f88-4ed0-85b2-6ca01ac3015b => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:54:27.343242 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-bf87c573-54db-401d-a400-40349c517eb6 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:54:27.343902 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-bf87c573-54db-401d-a400-40349c517eb6 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] [instance: 17c50765-6f88-4ed0-85b2-6ca01ac3015b] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:54:27.352600 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-bf87c573-54db-401d-a400-40349c517eb6 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:27.353283 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-bf87c573-54db-401d-a400-40349c517eb6 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:27.354183 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-bf87c573-54db-401d-a400-40349c517eb6 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:27.354526 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-bf87c573-54db-401d-a400-40349c517eb6 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:27.418584 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-bf87c573-54db-401d-a400-40349c517eb6 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d04261c643948c0b7d9a20579c52dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f5f72a0f2054b89bb61968a2de9f10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:54:27.426667 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-bf87c573-54db-401d-a400-40349c517eb6 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] 10.222.0.48 "GET /compute/v2.1/servers/17c50765-6f88-4ed0-85b2-6ca01ac3015b" status: 200 len: 1217 microversion: 2.1 time: 0.086910 Jul 21 10:54:27.433921 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 487/962] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:54:27 2022] GET /compute/v2.1/servers/17c50765-6f88-4ed0-85b2-6ca01ac3015b => generated 1217 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:54:28.451857 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-d8142048-6d45-4727-81d0-e25679b70133 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:54:28.452610 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-d8142048-6d45-4727-81d0-e25679b70133 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] [instance: 17c50765-6f88-4ed0-85b2-6ca01ac3015b] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:54:28.463705 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d8142048-6d45-4727-81d0-e25679b70133 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:28.465286 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d8142048-6d45-4727-81d0-e25679b70133 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:28.465286 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d8142048-6d45-4727-81d0-e25679b70133 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:28.465472 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d8142048-6d45-4727-81d0-e25679b70133 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:28.864970 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-d8142048-6d45-4727-81d0-e25679b70133 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d04261c643948c0b7d9a20579c52dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f5f72a0f2054b89bb61968a2de9f10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:54:28.873420 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-d8142048-6d45-4727-81d0-e25679b70133 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] 10.222.0.48 "GET /compute/v2.1/servers/17c50765-6f88-4ed0-85b2-6ca01ac3015b" status: 200 len: 1283 microversion: 2.1 time: 0.426253 Jul 21 10:54:28.884469 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 476/963] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:54:28 2022] GET /compute/v2.1/servers/17c50765-6f88-4ed0-85b2-6ca01ac3015b => generated 1283 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:54:29.894658 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-54661ea1-d828-401d-92a5-13e973bbff79 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:54:29.895132 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-54661ea1-d828-401d-92a5-13e973bbff79 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] [instance: 17c50765-6f88-4ed0-85b2-6ca01ac3015b] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:54:29.903637 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-54661ea1-d828-401d-92a5-13e973bbff79 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:29.904334 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-54661ea1-d828-401d-92a5-13e973bbff79 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:29.905113 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-54661ea1-d828-401d-92a5-13e973bbff79 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:29.905554 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-54661ea1-d828-401d-92a5-13e973bbff79 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:29.926205 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:54:30.180005 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-54661ea1-d828-401d-92a5-13e973bbff79 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d04261c643948c0b7d9a20579c52dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f5f72a0f2054b89bb61968a2de9f10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:54:30.191556 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-54661ea1-d828-401d-92a5-13e973bbff79 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] 10.222.0.48 "GET /compute/v2.1/servers/17c50765-6f88-4ed0-85b2-6ca01ac3015b" status: 200 len: 1313 microversion: 2.1 time: 0.299819 Jul 21 10:54:30.199552 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 488/964] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:54:29 2022] GET /compute/v2.1/servers/17c50765-6f88-4ed0-85b2-6ca01ac3015b => generated 1313 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:54:30.443720 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [req-45c6cfac-704a-474e-adb2-083f1cde3a8f req-f0a9014a-62ce-4e2d-8dcc-6a245e09bad1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17c50765-6f88-4ed0-85b2-6ca01ac3015b", "tag": "625ae809-9b6c-47fa-99e1-aa3c5b14cb81"}]} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:54:30.456868 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-45c6cfac-704a-474e-adb2-083f1cde3a8f req-f0a9014a-62ce-4e2d-8dcc-6a245e09bad1 service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:30.459366 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-45c6cfac-704a-474e-adb2-083f1cde3a8f req-f0a9014a-62ce-4e2d-8dcc-6a245e09bad1 service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:30.476157 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.compute.server_external_events [req-45c6cfac-704a-474e-adb2-083f1cde3a8f req-f0a9014a-62ce-4e2d-8dcc-6a245e09bad1 service nova] Creating event network-changed:625ae809-9b6c-47fa-99e1-aa3c5b14cb81 for instance 17c50765-6f88-4ed0-85b2-6ca01ac3015b on hv-cinder-84980 Jul 21 10:54:30.484636 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [req-45c6cfac-704a-474e-adb2-083f1cde3a8f req-f0a9014a-62ce-4e2d-8dcc-6a245e09bad1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051902 Jul 21 10:54:30.484636 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 477/965] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 21 10:54:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:54:31.212813 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-3972b636-445b-4edd-afd2-42957801fa59 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:54:31.214342 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-3972b636-445b-4edd-afd2-42957801fa59 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] [instance: 17c50765-6f88-4ed0-85b2-6ca01ac3015b] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:54:31.222565 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3972b636-445b-4edd-afd2-42957801fa59 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:31.223415 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3972b636-445b-4edd-afd2-42957801fa59 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:31.225789 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3972b636-445b-4edd-afd2-42957801fa59 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:31.226571 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3972b636-445b-4edd-afd2-42957801fa59 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:31.443317 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-3972b636-445b-4edd-afd2-42957801fa59 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d04261c643948c0b7d9a20579c52dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f5f72a0f2054b89bb61968a2de9f10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:54:31.462977 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-3972b636-445b-4edd-afd2-42957801fa59 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] 10.222.0.48 "GET /compute/v2.1/servers/17c50765-6f88-4ed0-85b2-6ca01ac3015b" status: 200 len: 1313 microversion: 2.1 time: 0.254249 Jul 21 10:54:31.465618 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 489/966] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:54:31 2022] GET /compute/v2.1/servers/17c50765-6f88-4ed0-85b2-6ca01ac3015b => generated 1313 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:54:31.604914 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-60fae9b4-f866-4105-b061-f7da84766050 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Action: 'create', calling method: .version_select at 0x7f7962931c10>, body: {"keypair": {"name": "tempest-keypair-182587622", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJsGnGu/Nv9PdUYj9XZZo8XKJJ8EwYY0mRGTzYG53evqzvhcxWXU9hC0RzytGtYj08KBHVkJSjah5eD2vExJfuiGjVnKCEWtdYWyNl4yXVxR4egPVHUE8NdsmgIgqrJgeQ=="}} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:54:31.621179 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.quota [None req-60fae9b4-f866-4105-b061-f7da84766050 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Getting quotas for project ce3ae8ed116141658017f823c633c2f2. Resources: {'key_pairs'} {{(pid=124868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 10:54:31.625366 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.quota [None req-60fae9b4-f866-4105-b061-f7da84766050 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Getting quotas for user 0d76fa94b5ff4721bf490efd0699688e and project ce3ae8ed116141658017f823c633c2f2. Resources: {'key_pairs'} {{(pid=124868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 10:54:31.708357 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-60fae9b4-f866-4105-b061-f7da84766050 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.275378 Jul 21 10:54:31.709009 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 478/967] 10.222.0.48 () {60 vars in 1158 bytes} [Thu Jul 21 10:54:31 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:54:32.481939 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-a4d78b6b-1f9c-4514-a1e1-a46344ceee5b tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:54:32.482661 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-a4d78b6b-1f9c-4514-a1e1-a46344ceee5b tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] [instance: 17c50765-6f88-4ed0-85b2-6ca01ac3015b] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:54:32.491035 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a4d78b6b-1f9c-4514-a1e1-a46344ceee5b tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:32.491558 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a4d78b6b-1f9c-4514-a1e1-a46344ceee5b tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:32.495860 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a4d78b6b-1f9c-4514-a1e1-a46344ceee5b tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:32.500276 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a4d78b6b-1f9c-4514-a1e1-a46344ceee5b tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:32.683764 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-a4d78b6b-1f9c-4514-a1e1-a46344ceee5b tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d04261c643948c0b7d9a20579c52dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f5f72a0f2054b89bb61968a2de9f10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:54:32.694151 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-a4d78b6b-1f9c-4514-a1e1-a46344ceee5b tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] 10.222.0.48 "GET /compute/v2.1/servers/17c50765-6f88-4ed0-85b2-6ca01ac3015b" status: 200 len: 1313 microversion: 2.1 time: 0.216244 Jul 21 10:54:32.695033 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 490/968] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:54:32 2022] GET /compute/v2.1/servers/17c50765-6f88-4ed0-85b2-6ca01ac3015b => generated 1313 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:54:33.711938 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-1770d565-a822-44d8-83dd-9ed59b83fbf6 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:54:33.713944 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-1770d565-a822-44d8-83dd-9ed59b83fbf6 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] [instance: 17c50765-6f88-4ed0-85b2-6ca01ac3015b] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:54:33.728808 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1770d565-a822-44d8-83dd-9ed59b83fbf6 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:33.729262 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1770d565-a822-44d8-83dd-9ed59b83fbf6 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:33.730040 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1770d565-a822-44d8-83dd-9ed59b83fbf6 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:33.730477 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1770d565-a822-44d8-83dd-9ed59b83fbf6 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:33.950891 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-1770d565-a822-44d8-83dd-9ed59b83fbf6 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d04261c643948c0b7d9a20579c52dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f5f72a0f2054b89bb61968a2de9f10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:54:33.960824 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-1770d565-a822-44d8-83dd-9ed59b83fbf6 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] 10.222.0.48 "GET /compute/v2.1/servers/17c50765-6f88-4ed0-85b2-6ca01ac3015b" status: 200 len: 1313 microversion: 2.1 time: 0.253826 Jul 21 10:54:33.971969 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 479/969] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:54:33 2022] GET /compute/v2.1/servers/17c50765-6f88-4ed0-85b2-6ca01ac3015b => generated 1313 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:54:34.268005 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-2dae0a10-3f51-4cf0-82ee-0926fa900ec7 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-390174589", "imageRef": "282ddb30-fa0f-489d-9cc3-a3e70e03c631", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fcf758b3-d1d0-4113-88a1-91bfb5fdc377"}], "security_groups": [{"name": "tempest-securitygroup--1729679247"}], "key_name": "tempest-keypair-182587622", "user_data": "}} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:54:34.445530 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.network.neutron [None req-2dae0a10-3f51-4cf0-82ee-0926fa900ec7 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] validate_networks() for [('fcf758b3-d1d0-4113-88a1-91bfb5fdc377', None, None, None, None, None)] {{(pid=124867) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 10:54:34.893763 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-2dae0a10-3f51-4cf0-82ee-0926fa900ec7 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Flavor limits 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 10:54:34.894177 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-2dae0a10-3f51-4cf0-82ee-0926fa900ec7 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Image limits 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 10:54:34.894675 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-2dae0a10-3f51-4cf0-82ee-0926fa900ec7 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Flavor pref 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 10:54:34.895078 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-2dae0a10-3f51-4cf0-82ee-0926fa900ec7 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Image pref 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 10:54:34.896235 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-2dae0a10-3f51-4cf0-82ee-0926fa900ec7 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 10:54:34.909066 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2dae0a10-3f51-4cf0-82ee-0926fa900ec7 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:34.909066 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2dae0a10-3f51-4cf0-82ee-0926fa900ec7 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:34.909066 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2dae0a10-3f51-4cf0-82ee-0926fa900ec7 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:34.909066 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2dae0a10-3f51-4cf0-82ee-0926fa900ec7 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:34.927921 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.quota [None req-2dae0a10-3f51-4cf0-82ee-0926fa900ec7 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Getting quotas for project ce3ae8ed116141658017f823c633c2f2. Resources: {'ram', 'instances', 'cores'} {{(pid=124867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 10:54:34.933268 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.quota [None req-2dae0a10-3f51-4cf0-82ee-0926fa900ec7 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Getting quotas for user 0d76fa94b5ff4721bf490efd0699688e and project ce3ae8ed116141658017f823c633c2f2. Resources: {'ram', 'instances', 'cores'} {{(pid=124867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 10:54:34.946084 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-2dae0a10-3f51-4cf0-82ee-0926fa900ec7 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Going to run 1 instances... {{(pid=124867) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 10:54:34.948241 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-2dae0a10-3f51-4cf0-82ee-0926fa900ec7 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] [instance: 5ec19443-8399-4f5f-b530-179ac8488e8a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='282ddb30-fa0f-489d-9cc3-a3e70e03c631',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124867) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 10:54:34.980171 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-017ca9a3-93ed-4272-9610-89ec96cec391 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:54:34.980780 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-017ca9a3-93ed-4272-9610-89ec96cec391 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] [instance: 17c50765-6f88-4ed0-85b2-6ca01ac3015b] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:54:34.994138 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-017ca9a3-93ed-4272-9610-89ec96cec391 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:34.994138 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-017ca9a3-93ed-4272-9610-89ec96cec391 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:34.997568 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-017ca9a3-93ed-4272-9610-89ec96cec391 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:34.999324 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-017ca9a3-93ed-4272-9610-89ec96cec391 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:35.108972 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-2dae0a10-3f51-4cf0-82ee-0926fa900ec7 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.845302 Jul 21 10:54:35.109882 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 491/970] 10.222.0.48 () {60 vars in 1146 bytes} [Thu Jul 21 10:54:34 2022] POST /compute/v2.1/servers => generated 402 bytes in 847 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 10:54:35.115737 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [req-4529be65-c40e-4502-99ae-ea4f4e62c40b req-757f41c0-2be4-49d5-96a4-ea4c43358ee7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17c50765-6f88-4ed0-85b2-6ca01ac3015b", "name": "network-vif-plugged", "status": "completed", "tag": "625ae809-9b6c-47fa-99e1-aa3c5b14cb81"}]} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:54:35.125580 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-4529be65-c40e-4502-99ae-ea4f4e62c40b req-757f41c0-2be4-49d5-96a4-ea4c43358ee7 service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:35.126403 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-4529be65-c40e-4502-99ae-ea4f4e62c40b req-757f41c0-2be4-49d5-96a4-ea4c43358ee7 service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:35.143153 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.compute.server_external_events [req-4529be65-c40e-4502-99ae-ea4f4e62c40b req-757f41c0-2be4-49d5-96a4-ea4c43358ee7 service nova] Creating event network-vif-plugged:625ae809-9b6c-47fa-99e1-aa3c5b14cb81 for instance 17c50765-6f88-4ed0-85b2-6ca01ac3015b on hv-cinder-84980 Jul 21 10:54:35.148849 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [req-4529be65-c40e-4502-99ae-ea4f4e62c40b req-757f41c0-2be4-49d5-96a4-ea4c43358ee7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037413 Jul 21 10:54:35.149509 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 492/971] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 21 10:54:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:54:35.166011 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-ee72262a-0bf0-4aa5-93e3-3a762bb87615 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:54:35.176061 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-ee72262a-0bf0-4aa5-93e3-3a762bb87615 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] [instance: 5ec19443-8399-4f5f-b530-179ac8488e8a] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:54:35.182457 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-017ca9a3-93ed-4272-9610-89ec96cec391 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d04261c643948c0b7d9a20579c52dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f5f72a0f2054b89bb61968a2de9f10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:54:35.186399 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell1:SELECT=100 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:54:35.196952 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-017ca9a3-93ed-4272-9610-89ec96cec391 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] 10.222.0.48 "GET /compute/v2.1/servers/17c50765-6f88-4ed0-85b2-6ca01ac3015b" status: 200 len: 1313 microversion: 2.1 time: 0.220483 Jul 21 10:54:35.197792 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 480/972] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:54:34 2022] GET /compute/v2.1/servers/17c50765-6f88-4ed0-85b2-6ca01ac3015b => generated 1313 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:54:35.274764 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-ee72262a-0bf0-4aa5-93e3-3a762bb87615 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d76fa94b5ff4721bf490efd0699688e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3ae8ed116141658017f823c633c2f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:54:35.286656 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-ee72262a-0bf0-4aa5-93e3-3a762bb87615 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] 10.222.0.48 "GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a" status: 200 len: 1236 microversion: 2.1 time: 0.132806 Jul 21 10:54:35.286656 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 493/973] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:54:35 2022] GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a => generated 1236 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:54:36.213899 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-3ff3aea3-3ea9-4e65-bfe4-7d0f7276ef14 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:54:36.214515 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-3ff3aea3-3ea9-4e65-bfe4-7d0f7276ef14 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] [instance: 17c50765-6f88-4ed0-85b2-6ca01ac3015b] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:54:36.221093 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3ff3aea3-3ea9-4e65-bfe4-7d0f7276ef14 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:36.221549 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3ff3aea3-3ea9-4e65-bfe4-7d0f7276ef14 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:36.223875 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3ff3aea3-3ea9-4e65-bfe4-7d0f7276ef14 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:36.223875 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3ff3aea3-3ea9-4e65-bfe4-7d0f7276ef14 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:36.302685 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-d1b5b376-1778-4912-a046-3daefeb3a8a9 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:54:36.303362 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-d1b5b376-1778-4912-a046-3daefeb3a8a9 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] [instance: 5ec19443-8399-4f5f-b530-179ac8488e8a] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:54:36.313427 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d1b5b376-1778-4912-a046-3daefeb3a8a9 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:36.313884 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d1b5b376-1778-4912-a046-3daefeb3a8a9 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:36.314689 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d1b5b376-1778-4912-a046-3daefeb3a8a9 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:36.315131 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-d1b5b376-1778-4912-a046-3daefeb3a8a9 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:36.414911 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-d1b5b376-1778-4912-a046-3daefeb3a8a9 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d76fa94b5ff4721bf490efd0699688e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3ae8ed116141658017f823c633c2f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:54:36.422505 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-3ff3aea3-3ea9-4e65-bfe4-7d0f7276ef14 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d04261c643948c0b7d9a20579c52dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f5f72a0f2054b89bb61968a2de9f10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:54:36.429996 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-d1b5b376-1778-4912-a046-3daefeb3a8a9 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] 10.222.0.48 "GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a" status: 200 len: 1240 microversion: 2.1 time: 0.131362 Jul 21 10:54:36.431096 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-3ff3aea3-3ea9-4e65-bfe4-7d0f7276ef14 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] 10.222.0.48 "GET /compute/v2.1/servers/17c50765-6f88-4ed0-85b2-6ca01ac3015b" status: 200 len: 1313 microversion: 2.1 time: 0.221554 Jul 21 10:54:36.432153 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 481/975] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:54:36 2022] GET /compute/v2.1/servers/17c50765-6f88-4ed0-85b2-6ca01ac3015b => generated 1313 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:54:36.440187 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 494/975] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:54:36 2022] GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a => generated 1240 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:54:37.447904 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-07ad7cd6-c53d-453c-8f5b-a0a096fe4169 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:54:37.448467 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-2ebb4ad3-e52a-4f47-9931-ef06d1174214 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:54:37.448889 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-07ad7cd6-c53d-453c-8f5b-a0a096fe4169 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] [instance: 5ec19443-8399-4f5f-b530-179ac8488e8a] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:54:37.449012 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-2ebb4ad3-e52a-4f47-9931-ef06d1174214 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] [instance: 17c50765-6f88-4ed0-85b2-6ca01ac3015b] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:54:37.451011 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=4 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:54:37.452233 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:54:37.455581 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-07ad7cd6-c53d-453c-8f5b-a0a096fe4169 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:37.455754 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2ebb4ad3-e52a-4f47-9931-ef06d1174214 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:37.456161 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-07ad7cd6-c53d-453c-8f5b-a0a096fe4169 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:37.456284 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2ebb4ad3-e52a-4f47-9931-ef06d1174214 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:37.456958 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2ebb4ad3-e52a-4f47-9931-ef06d1174214 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:37.457090 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-07ad7cd6-c53d-453c-8f5b-a0a096fe4169 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:37.457394 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2ebb4ad3-e52a-4f47-9931-ef06d1174214 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:37.457511 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-07ad7cd6-c53d-453c-8f5b-a0a096fe4169 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:37.543992 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-07ad7cd6-c53d-453c-8f5b-a0a096fe4169 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d76fa94b5ff4721bf490efd0699688e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3ae8ed116141658017f823c633c2f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:54:37.552267 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-07ad7cd6-c53d-453c-8f5b-a0a096fe4169 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] 10.222.0.48 "GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a" status: 200 len: 1288 microversion: 2.1 time: 0.107799 Jul 21 10:54:37.553383 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 482/976] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:54:37 2022] GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a => generated 1288 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:54:37.613744 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-2ebb4ad3-e52a-4f47-9931-ef06d1174214 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d04261c643948c0b7d9a20579c52dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f5f72a0f2054b89bb61968a2de9f10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:54:37.621800 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-2ebb4ad3-e52a-4f47-9931-ef06d1174214 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] 10.222.0.48 "GET /compute/v2.1/servers/17c50765-6f88-4ed0-85b2-6ca01ac3015b" status: 200 len: 1498 microversion: 2.1 time: 0.177753 Jul 21 10:54:37.622461 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 495/977] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:54:37 2022] GET /compute/v2.1/servers/17c50765-6f88-4ed0-85b2-6ca01ac3015b => generated 1498 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:54:38.576648 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-ddaff9d1-b957-4d99-b0b7-335da188708e tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:54:38.576648 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-ddaff9d1-b957-4d99-b0b7-335da188708e tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] [instance: 5ec19443-8399-4f5f-b530-179ac8488e8a] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:54:38.580510 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ddaff9d1-b957-4d99-b0b7-335da188708e tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:38.580949 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ddaff9d1-b957-4d99-b0b7-335da188708e tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:38.581704 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ddaff9d1-b957-4d99-b0b7-335da188708e tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:38.582135 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ddaff9d1-b957-4d99-b0b7-335da188708e tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:38.584538 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-326e8881-cddf-4863-ab6f-2a60a9132fe1 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:54:38.585104 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-326e8881-cddf-4863-ab6f-2a60a9132fe1 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] [instance: 17c50765-6f88-4ed0-85b2-6ca01ac3015b] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:54:38.592472 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-326e8881-cddf-4863-ab6f-2a60a9132fe1 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:38.592984 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-326e8881-cddf-4863-ab6f-2a60a9132fe1 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:38.599388 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-326e8881-cddf-4863-ab6f-2a60a9132fe1 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:38.599388 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-326e8881-cddf-4863-ab6f-2a60a9132fe1 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:38.620587 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-326e8881-cddf-4863-ab6f-2a60a9132fe1 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] [instance: 17c50765-6f88-4ed0-85b2-6ca01ac3015b] Going to try to terminate instance {{(pid=124867) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 10:54:38.648346 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-ddaff9d1-b957-4d99-b0b7-335da188708e tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d76fa94b5ff4721bf490efd0699688e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3ae8ed116141658017f823c633c2f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:54:38.655952 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-ddaff9d1-b957-4d99-b0b7-335da188708e tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] 10.222.0.48 "GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a" status: 200 len: 1294 microversion: 2.1 time: 0.089968 Jul 21 10:54:38.656837 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 483/978] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:54:38 2022] GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a => generated 1294 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:54:39.094863 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-326e8881-cddf-4863-ab6f-2a60a9132fe1 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] 10.222.0.48 "DELETE /compute/v2.1/servers/17c50765-6f88-4ed0-85b2-6ca01ac3015b" status: 204 len: 0 microversion: 2.1 time: 0.515671 Jul 21 10:54:39.096160 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 496/979] 10.222.0.48 () {58 vars in 1238 bytes} [Thu Jul 21 10:54:38 2022] DELETE /compute/v2.1/servers/17c50765-6f88-4ed0-85b2-6ca01ac3015b => generated 0 bytes in 518 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 10:54:39.104708 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-d5305438-73e2-434f-9f78-01cd80c4d88e tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:54:39.105414 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-d5305438-73e2-434f-9f78-01cd80c4d88e tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] [instance: 17c50765-6f88-4ed0-85b2-6ca01ac3015b] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:54:39.111779 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d5305438-73e2-434f-9f78-01cd80c4d88e tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:39.112330 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d5305438-73e2-434f-9f78-01cd80c4d88e tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:39.113155 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d5305438-73e2-434f-9f78-01cd80c4d88e tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:39.113588 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d5305438-73e2-434f-9f78-01cd80c4d88e tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:39.253275 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-d5305438-73e2-434f-9f78-01cd80c4d88e tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d04261c643948c0b7d9a20579c52dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f5f72a0f2054b89bb61968a2de9f10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:54:39.263095 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-d5305438-73e2-434f-9f78-01cd80c4d88e tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] 10.222.0.48 "GET /compute/v2.1/servers/17c50765-6f88-4ed0-85b2-6ca01ac3015b" status: 200 len: 1504 microversion: 2.1 time: 0.162221 Jul 21 10:54:39.264255 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 484/980] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:54:39 2022] GET /compute/v2.1/servers/17c50765-6f88-4ed0-85b2-6ca01ac3015b => generated 1504 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:54:39.677903 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-4c313a36-3cca-4a6d-add8-f9da7227b2b2 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:54:39.678636 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-4c313a36-3cca-4a6d-add8-f9da7227b2b2 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] [instance: 5ec19443-8399-4f5f-b530-179ac8488e8a] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:54:39.684698 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-4c313a36-3cca-4a6d-add8-f9da7227b2b2 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:39.685144 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-4c313a36-3cca-4a6d-add8-f9da7227b2b2 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:39.685912 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-4c313a36-3cca-4a6d-add8-f9da7227b2b2 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:39.686344 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-4c313a36-3cca-4a6d-add8-f9da7227b2b2 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:39.836874 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-4c313a36-3cca-4a6d-add8-f9da7227b2b2 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d76fa94b5ff4721bf490efd0699688e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3ae8ed116141658017f823c633c2f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:54:39.844939 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-4c313a36-3cca-4a6d-add8-f9da7227b2b2 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] 10.222.0.48 "GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a" status: 200 len: 1362 microversion: 2.1 time: 0.174754 Jul 21 10:54:39.845585 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 497/981] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:54:39 2022] GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a => generated 1362 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:54:40.049805 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [req-f0fb674b-f52d-4bd3-92ef-175b86ee7506 req-a42b7d71-e5d5-4667-b5ca-2309d0ef9d0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ec19443-8399-4f5f-b530-179ac8488e8a", "tag": "9413091b-0c11-431b-a541-d2ab3dd8bc2f"}]} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:54:40.066299 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-f0fb674b-f52d-4bd3-92ef-175b86ee7506 req-a42b7d71-e5d5-4667-b5ca-2309d0ef9d0e service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:40.066882 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-f0fb674b-f52d-4bd3-92ef-175b86ee7506 req-a42b7d71-e5d5-4667-b5ca-2309d0ef9d0e service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:40.080203 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.compute.server_external_events [req-f0fb674b-f52d-4bd3-92ef-175b86ee7506 req-a42b7d71-e5d5-4667-b5ca-2309d0ef9d0e service nova] Creating event network-changed:9413091b-0c11-431b-a541-d2ab3dd8bc2f for instance 5ec19443-8399-4f5f-b530-179ac8488e8a on hv-cinder-84980 Jul 21 10:54:40.089680 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [req-f0fb674b-f52d-4bd3-92ef-175b86ee7506 req-a42b7d71-e5d5-4667-b5ca-2309d0ef9d0e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043591 Jul 21 10:54:40.090600 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 485/982] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 21 10:54:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 10:54:40.281424 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-58378901-c881-406d-8125-d4be372a6d4e tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:54:40.282417 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-58378901-c881-406d-8125-d4be372a6d4e tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] [instance: 17c50765-6f88-4ed0-85b2-6ca01ac3015b] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:54:40.289456 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-58378901-c881-406d-8125-d4be372a6d4e tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:40.289841 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-58378901-c881-406d-8125-d4be372a6d4e tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:40.290842 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-58378901-c881-406d-8125-d4be372a6d4e tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:40.291524 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-58378901-c881-406d-8125-d4be372a6d4e tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:40.440592 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-58378901-c881-406d-8125-d4be372a6d4e tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d04261c643948c0b7d9a20579c52dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f5f72a0f2054b89bb61968a2de9f10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:54:40.449251 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-58378901-c881-406d-8125-d4be372a6d4e tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] 10.222.0.48 "GET /compute/v2.1/servers/17c50765-6f88-4ed0-85b2-6ca01ac3015b" status: 200 len: 1504 microversion: 2.1 time: 0.171694 Jul 21 10:54:40.449807 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 498/983] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:54:40 2022] GET /compute/v2.1/servers/17c50765-6f88-4ed0-85b2-6ca01ac3015b => generated 1504 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:54:40.863270 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-27276baf-8d64-4e28-b168-30a8a21d6ded tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:54:40.863962 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-27276baf-8d64-4e28-b168-30a8a21d6ded tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] [instance: 5ec19443-8399-4f5f-b530-179ac8488e8a] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:54:40.870559 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-27276baf-8d64-4e28-b168-30a8a21d6ded tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:40.871022 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-27276baf-8d64-4e28-b168-30a8a21d6ded tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:40.871792 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-27276baf-8d64-4e28-b168-30a8a21d6ded tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:40.872228 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-27276baf-8d64-4e28-b168-30a8a21d6ded tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:41.009976 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-27276baf-8d64-4e28-b168-30a8a21d6ded tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d76fa94b5ff4721bf490efd0699688e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3ae8ed116141658017f823c633c2f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:54:41.017770 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-27276baf-8d64-4e28-b168-30a8a21d6ded tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] 10.222.0.48 "GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a" status: 200 len: 1362 microversion: 2.1 time: 0.158729 Jul 21 10:54:41.018701 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 486/984] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:54:40 2022] GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:54:41.474956 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-6a59e852-9b7f-4ff8-b2e3-f6a19c35cfc3 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:54:41.476090 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-6a59e852-9b7f-4ff8-b2e3-f6a19c35cfc3 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] [instance: 17c50765-6f88-4ed0-85b2-6ca01ac3015b] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:54:41.484433 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6a59e852-9b7f-4ff8-b2e3-f6a19c35cfc3 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:41.485095 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6a59e852-9b7f-4ff8-b2e3-f6a19c35cfc3 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:41.486107 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6a59e852-9b7f-4ff8-b2e3-f6a19c35cfc3 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:41.486737 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6a59e852-9b7f-4ff8-b2e3-f6a19c35cfc3 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:41.552924 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-6a59e852-9b7f-4ff8-b2e3-f6a19c35cfc3 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d04261c643948c0b7d9a20579c52dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f5f72a0f2054b89bb61968a2de9f10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:54:41.560954 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-6a59e852-9b7f-4ff8-b2e3-f6a19c35cfc3 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] 10.222.0.48 "GET /compute/v2.1/servers/17c50765-6f88-4ed0-85b2-6ca01ac3015b" status: 200 len: 1462 microversion: 2.1 time: 0.092754 Jul 21 10:54:41.561530 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 499/985] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:54:41 2022] GET /compute/v2.1/servers/17c50765-6f88-4ed0-85b2-6ca01ac3015b => generated 1462 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:54:42.036312 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-fa3956c5-cbc3-44c6-a074-d02623a47bef tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:54:42.037090 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-fa3956c5-cbc3-44c6-a074-d02623a47bef tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] [instance: 5ec19443-8399-4f5f-b530-179ac8488e8a] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:54:42.039338 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell0:SELECT=6 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:54:42.044406 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-fa3956c5-cbc3-44c6-a074-d02623a47bef tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:42.047653 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-fa3956c5-cbc3-44c6-a074-d02623a47bef tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:42.047653 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-fa3956c5-cbc3-44c6-a074-d02623a47bef tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:42.047653 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-fa3956c5-cbc3-44c6-a074-d02623a47bef tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:42.109161 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [req-19a08aea-d720-422f-a4e8-d6c43c41e07a req-4113a887-ad9f-40d7-adf1-7f36419ff3d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17c50765-6f88-4ed0-85b2-6ca01ac3015b", "name": "network-vif-deleted", "tag": "625ae809-9b6c-47fa-99e1-aa3c5b14cb81"}]} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:54:42.119368 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-19a08aea-d720-422f-a4e8-d6c43c41e07a req-4113a887-ad9f-40d7-adf1-7f36419ff3d6 service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:42.120145 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-19a08aea-d720-422f-a4e8-d6c43c41e07a req-4113a887-ad9f-40d7-adf1-7f36419ff3d6 service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:42.131325 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.compute.server_external_events [req-19a08aea-d720-422f-a4e8-d6c43c41e07a req-4113a887-ad9f-40d7-adf1-7f36419ff3d6 service nova] Creating event network-vif-deleted:625ae809-9b6c-47fa-99e1-aa3c5b14cb81 for instance 17c50765-6f88-4ed0-85b2-6ca01ac3015b on hv-cinder-84980 Jul 21 10:54:42.135787 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [req-19a08aea-d720-422f-a4e8-d6c43c41e07a req-4113a887-ad9f-40d7-adf1-7f36419ff3d6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030619 Jul 21 10:54:42.136372 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 500/986] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 21 10:54:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:54:42.185500 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-fa3956c5-cbc3-44c6-a074-d02623a47bef tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d76fa94b5ff4721bf490efd0699688e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3ae8ed116141658017f823c633c2f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:54:42.193361 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-fa3956c5-cbc3-44c6-a074-d02623a47bef tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] 10.222.0.48 "GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a" status: 200 len: 1362 microversion: 2.1 time: 0.161353 Jul 21 10:54:42.193938 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 487/987] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:54:42 2022] GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:54:42.579562 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-06ad859c-cc16-4589-b8a4-271fd3d21094 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:54:42.580253 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-06ad859c-cc16-4589-b8a4-271fd3d21094 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] [instance: 17c50765-6f88-4ed0-85b2-6ca01ac3015b] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:54:42.587284 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-06ad859c-cc16-4589-b8a4-271fd3d21094 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:42.587727 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-06ad859c-cc16-4589-b8a4-271fd3d21094 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:42.588505 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-06ad859c-cc16-4589-b8a4-271fd3d21094 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:42.588943 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-06ad859c-cc16-4589-b8a4-271fd3d21094 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:42.621268 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-06ad859c-cc16-4589-b8a4-271fd3d21094 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:42.621717 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-06ad859c-cc16-4589-b8a4-271fd3d21094 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:42.622169 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.objects.instance [None req-06ad859c-cc16-4589-b8a4-271fd3d21094 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lazy-loading 'fault' on Instance uuid 17c50765-6f88-4ed0-85b2-6ca01ac3015b {{(pid=124867) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 10:54:42.666156 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-06ad859c-cc16-4589-b8a4-271fd3d21094 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d04261c643948c0b7d9a20579c52dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f5f72a0f2054b89bb61968a2de9f10a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:54:42.673646 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-06ad859c-cc16-4589-b8a4-271fd3d21094 tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] 10.222.0.48 "GET /compute/v2.1/servers/17c50765-6f88-4ed0-85b2-6ca01ac3015b" status: 200 len: 1303 microversion: 2.1 time: 0.098869 Jul 21 10:54:42.674208 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 501/988] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:54:42 2022] GET /compute/v2.1/servers/17c50765-6f88-4ed0-85b2-6ca01ac3015b => generated 1303 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:54:43.208952 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-1eb8f232-3dfe-4cd3-aa8a-fb24b0030287 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:54:43.209576 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-1eb8f232-3dfe-4cd3-aa8a-fb24b0030287 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] [instance: 5ec19443-8399-4f5f-b530-179ac8488e8a] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:54:43.216789 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1eb8f232-3dfe-4cd3-aa8a-fb24b0030287 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:43.217238 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1eb8f232-3dfe-4cd3-aa8a-fb24b0030287 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:43.218012 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1eb8f232-3dfe-4cd3-aa8a-fb24b0030287 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:43.218452 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1eb8f232-3dfe-4cd3-aa8a-fb24b0030287 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:43.360648 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-1eb8f232-3dfe-4cd3-aa8a-fb24b0030287 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d76fa94b5ff4721bf490efd0699688e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3ae8ed116141658017f823c633c2f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:54:43.367806 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-1eb8f232-3dfe-4cd3-aa8a-fb24b0030287 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] 10.222.0.48 "GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a" status: 200 len: 1362 microversion: 2.1 time: 0.162644 Jul 21 10:54:43.368369 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 488/989] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:54:43 2022] GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:54:43.691264 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-505bb4a4-6866-4f34-8764-299cb3e8d8bc tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:54:43.691863 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-505bb4a4-6866-4f34-8764-299cb3e8d8bc tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] [instance: 17c50765-6f88-4ed0-85b2-6ca01ac3015b] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:54:43.699519 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-505bb4a4-6866-4f34-8764-299cb3e8d8bc tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:43.699953 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-505bb4a4-6866-4f34-8764-299cb3e8d8bc tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:43.700728 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-505bb4a4-6866-4f34-8764-299cb3e8d8bc tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:43.701180 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-505bb4a4-6866-4f34-8764-299cb3e8d8bc tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:43.719049 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.wsgi [None req-505bb4a4-6866-4f34-8764-299cb3e8d8bc tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] HTTP exception thrown: Instance 17c50765-6f88-4ed0-85b2-6ca01ac3015b could not be found. Jul 21 10:54:43.720702 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-505bb4a4-6866-4f34-8764-299cb3e8d8bc tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Request method failure captured: Jul 21 10:54:43.720702 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: request: GET /compute/v2.1/servers/17c50765-6f88-4ed0-85b2-6ca01ac3015b HTTP/1.1 Jul 21 10:54:43.720702 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Accept: application/json Jul 21 10:54:43.720702 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Accept-Encoding: identity Jul 21 10:54:43.720702 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Connection: close Jul 21 10:54:43.720702 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Content-Length: 0 Jul 21 10:54:43.720702 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Content-Type: application/json Jul 21 10:54:43.720702 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Host: 10.222.0.48 Jul 21 10:54:43.720702 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Openstack-System-Scope: None Jul 21 10:54:43.720702 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: User-Agent: python-urllib3/1.26.9 Jul 21 10:54:43.720702 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Auth-Token: gAAAAABi2TBNpWzdIdA7OJ7UdOd1Jej4w60y1Za-lT6rSvbLpunqiTctDBPHTU4-GHvdkGbQw1E70WlsCQRdYCTVUquAD4gduJZQBqrEc9wkq-vm6o4ZcmcQEblJWnWfYO4uDik-WqmInbw-uOapKAzDbfyzDc1fraNSJXjy7bfblNAKQnmb4Ow Jul 21 10:54:43.720702 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Domain-Id: None Jul 21 10:54:43.720702 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Domain-Name: None Jul 21 10:54:43.720702 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Identity-Status: Confirmed Jul 21 10:54:43.720702 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Is-Admin-Project: True Jul 21 10:54:43.720702 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Project-Domain-Id: default Jul 21 10:54:43.720702 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Project-Domain-Name: Default Jul 21 10:54:43.720702 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Project-Id: 0f5f72a0f2054b89bb61968a2de9f10a Jul 21 10:54:43.720702 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Project-Name: tempest-VolumesActionsTest-794086169 Jul 21 10:54:43.720702 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Role: reader,member Jul 21 10:54:43.720702 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Roles: reader,member Jul 21 10:54:43.722305 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0f5f72a0f2054b89bb61968a2de9f10a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0f5f72a0f2054b89bb61968a2de9f10a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0f5f72a0f2054b89bb61968a2de9f10a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0f5f72a0f2054b89bb61968a2de9f10a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] Jul 21 10:54:43.722305 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Tenant: tempest-VolumesActionsTest-794086169 Jul 21 10:54:43.722305 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Tenant-Id: 0f5f72a0f2054b89bb61968a2de9f10a Jul 21 10:54:43.722305 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Tenant-Name: tempest-VolumesActionsTest-794086169 Jul 21 10:54:43.722305 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User: tempest-VolumesActionsTest-794086169-project Jul 21 10:54:43.722305 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User-Domain-Id: default Jul 21 10:54:43.722305 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User-Domain-Name: Default Jul 21 10:54:43.722305 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User-Id: 1d04261c643948c0b7d9a20579c52dae Jul 21 10:54:43.722305 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User-Name: tempest-VolumesActionsTest-794086169-project Jul 21 10:54:43.722305 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: method: > Jul 21 10:54:43.722305 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: exception: Instance 17c50765-6f88-4ed0-85b2-6ca01ac3015b could not be found. Jul 21 10:54:43.722305 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: action_args: {'id': '17c50765-6f88-4ed0-85b2-6ca01ac3015b'} Jul 21 10:54:43.723213 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 10:54:43.723213 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:54:43.723213 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 10:54:43.723213 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 10:54:43.723213 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 10:54:43.723213 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 10:54:43.723213 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 10:54:43.723213 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 10:54:43.723213 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 10:54:43.723213 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 10:54:43.723213 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17c50765-6f88-4ed0-85b2-6ca01ac3015b could not be found. Jul 21 10:54:43.723213 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:54:43.723213 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:54:43.723213 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:54:43.723213 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:54:43.723213 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:54:43.723213 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:54:43.723213 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 10:54:43.723213 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 10:54:43.723213 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 10:54:43.724762 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 10:54:43.724762 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 10:54:43.724762 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 10:54:43.724762 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 10:54:43.724762 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 10:54:43.724762 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 10:54:43.724762 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 10:54:43.724762 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17c50765-6f88-4ed0-85b2-6ca01ac3015b could not be found. Jul 21 10:54:43.724762 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:54:43.724762 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:54:43.724762 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:54:43.724762 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:54:43.724762 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:54:43.724762 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:54:43.724762 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 10:54:43.724762 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 10:54:43.724762 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17c50765-6f88-4ed0-85b2-6ca01ac3015b could not be found. Jul 21 10:54:43.724762 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:54:43.726255 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-505bb4a4-6866-4f34-8764-299cb3e8d8bc tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] Returning 404 to user: Instance 17c50765-6f88-4ed0-85b2-6ca01ac3015b could not be found. {{(pid=124867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 10:54:43.726255 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-505bb4a4-6866-4f34-8764-299cb3e8d8bc tempest-VolumesActionsTest-794086169 tempest-VolumesActionsTest-794086169-project] 10.222.0.48 "GET /compute/v2.1/servers/17c50765-6f88-4ed0-85b2-6ca01ac3015b" status: 404 len: 111 microversion: 2.1 time: 0.034654 Jul 21 10:54:43.726255 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 502/990] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:54:43 2022] GET /compute/v2.1/servers/17c50765-6f88-4ed0-85b2-6ca01ac3015b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 10:54:44.385329 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-5adc0985-025f-4fde-bd08-d21cd2e14d2c tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:54:44.385940 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-5adc0985-025f-4fde-bd08-d21cd2e14d2c tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] [instance: 5ec19443-8399-4f5f-b530-179ac8488e8a] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:54:44.392464 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5adc0985-025f-4fde-bd08-d21cd2e14d2c tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:44.393103 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5adc0985-025f-4fde-bd08-d21cd2e14d2c tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:44.393875 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5adc0985-025f-4fde-bd08-d21cd2e14d2c tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:44.394347 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5adc0985-025f-4fde-bd08-d21cd2e14d2c tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:44.530401 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-5adc0985-025f-4fde-bd08-d21cd2e14d2c tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d76fa94b5ff4721bf490efd0699688e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3ae8ed116141658017f823c633c2f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:54:44.538258 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-5adc0985-025f-4fde-bd08-d21cd2e14d2c tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] 10.222.0.48 "GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a" status: 200 len: 1362 microversion: 2.1 time: 0.157371 Jul 21 10:54:44.539228 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 489/991] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:54:44 2022] GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:54:45.078460 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [req-1bee5454-b3ca-4a0a-bc96-2e0fc093bd01 req-b44a3504-c5d9-40f8-9954-b6af2248acaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ec19443-8399-4f5f-b530-179ac8488e8a", "name": "network-vif-plugged", "status": "completed", "tag": "9413091b-0c11-431b-a541-d2ab3dd8bc2f"}]} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:54:45.084872 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell0:SELECT=4 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:54:45.092663 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-1bee5454-b3ca-4a0a-bc96-2e0fc093bd01 req-b44a3504-c5d9-40f8-9954-b6af2248acaa service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:45.096423 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-1bee5454-b3ca-4a0a-bc96-2e0fc093bd01 req-b44a3504-c5d9-40f8-9954-b6af2248acaa service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:45.110717 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.compute.server_external_events [req-1bee5454-b3ca-4a0a-bc96-2e0fc093bd01 req-b44a3504-c5d9-40f8-9954-b6af2248acaa service nova] Creating event network-vif-plugged:9413091b-0c11-431b-a541-d2ab3dd8bc2f for instance 5ec19443-8399-4f5f-b530-179ac8488e8a on hv-cinder-84980 Jul 21 10:54:45.117689 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [req-1bee5454-b3ca-4a0a-bc96-2e0fc093bd01 req-b44a3504-c5d9-40f8-9954-b6af2248acaa service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042192 Jul 21 10:54:45.119504 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 503/992] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 21 10:54:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:54:45.556525 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-d666771d-0351-43c6-8da5-fadbfd4663f9 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:54:45.557145 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-d666771d-0351-43c6-8da5-fadbfd4663f9 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] [instance: 5ec19443-8399-4f5f-b530-179ac8488e8a] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:54:45.564778 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d666771d-0351-43c6-8da5-fadbfd4663f9 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:45.565232 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d666771d-0351-43c6-8da5-fadbfd4663f9 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:45.565998 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d666771d-0351-43c6-8da5-fadbfd4663f9 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:45.566434 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d666771d-0351-43c6-8da5-fadbfd4663f9 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:45.751728 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-d666771d-0351-43c6-8da5-fadbfd4663f9 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d76fa94b5ff4721bf490efd0699688e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3ae8ed116141658017f823c633c2f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:54:45.761724 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-d666771d-0351-43c6-8da5-fadbfd4663f9 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] 10.222.0.48 "GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a" status: 200 len: 1362 microversion: 2.1 time: 0.209797 Jul 21 10:54:45.762448 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 490/993] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:54:45 2022] GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a => generated 1362 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:54:46.779852 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-46cbbfe2-430c-4bc0-83ef-df1bd72627c4 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:54:46.780798 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-46cbbfe2-430c-4bc0-83ef-df1bd72627c4 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] [instance: 5ec19443-8399-4f5f-b530-179ac8488e8a] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:54:46.782836 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell0:SELECT=14 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:54:46.790157 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-46cbbfe2-430c-4bc0-83ef-df1bd72627c4 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:46.790724 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-46cbbfe2-430c-4bc0-83ef-df1bd72627c4 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:46.791494 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-46cbbfe2-430c-4bc0-83ef-df1bd72627c4 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:46.791928 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-46cbbfe2-430c-4bc0-83ef-df1bd72627c4 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:46.946863 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-46cbbfe2-430c-4bc0-83ef-df1bd72627c4 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d76fa94b5ff4721bf490efd0699688e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3ae8ed116141658017f823c633c2f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:54:46.954360 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-46cbbfe2-430c-4bc0-83ef-df1bd72627c4 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] 10.222.0.48 "GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a" status: 200 len: 1362 microversion: 2.1 time: 0.178667 Jul 21 10:54:46.955122 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 504/994] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:54:46 2022] GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a => generated 1362 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:54:47.970984 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-e61b1665-28c8-4597-924f-4966769316d9 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:54:47.971595 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-e61b1665-28c8-4597-924f-4966769316d9 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] [instance: 5ec19443-8399-4f5f-b530-179ac8488e8a] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:54:47.978069 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e61b1665-28c8-4597-924f-4966769316d9 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:47.978517 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e61b1665-28c8-4597-924f-4966769316d9 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:47.980493 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e61b1665-28c8-4597-924f-4966769316d9 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:47.980493 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e61b1665-28c8-4597-924f-4966769316d9 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:48.119066 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-e61b1665-28c8-4597-924f-4966769316d9 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d76fa94b5ff4721bf490efd0699688e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3ae8ed116141658017f823c633c2f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:54:48.126626 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-e61b1665-28c8-4597-924f-4966769316d9 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] 10.222.0.48 "GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a" status: 200 len: 1362 microversion: 2.1 time: 0.159466 Jul 21 10:54:48.127203 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 491/995] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:54:47 2022] GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:54:49.144869 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-c77a2792-c5d9-45f4-8455-0f6a8f126d41 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:54:49.145487 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-c77a2792-c5d9-45f4-8455-0f6a8f126d41 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] [instance: 5ec19443-8399-4f5f-b530-179ac8488e8a] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:54:49.153625 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c77a2792-c5d9-45f4-8455-0f6a8f126d41 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:49.154088 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c77a2792-c5d9-45f4-8455-0f6a8f126d41 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:49.154913 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c77a2792-c5d9-45f4-8455-0f6a8f126d41 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:49.155354 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c77a2792-c5d9-45f4-8455-0f6a8f126d41 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:49.298406 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-c77a2792-c5d9-45f4-8455-0f6a8f126d41 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d76fa94b5ff4721bf490efd0699688e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3ae8ed116141658017f823c633c2f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:54:49.307279 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-c77a2792-c5d9-45f4-8455-0f6a8f126d41 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] 10.222.0.48 "GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a" status: 200 len: 1362 microversion: 2.1 time: 0.165844 Jul 21 10:54:49.307998 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 505/996] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:54:49 2022] GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:54:50.324568 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-b36c8f6d-5c40-4042-8fe1-efe3374de254 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:54:50.325187 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-b36c8f6d-5c40-4042-8fe1-efe3374de254 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] [instance: 5ec19443-8399-4f5f-b530-179ac8488e8a] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:54:50.332167 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b36c8f6d-5c40-4042-8fe1-efe3374de254 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:50.332873 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b36c8f6d-5c40-4042-8fe1-efe3374de254 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:50.333923 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b36c8f6d-5c40-4042-8fe1-efe3374de254 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:50.334367 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b36c8f6d-5c40-4042-8fe1-efe3374de254 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:50.473977 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-b36c8f6d-5c40-4042-8fe1-efe3374de254 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d76fa94b5ff4721bf490efd0699688e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3ae8ed116141658017f823c633c2f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:54:50.482124 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-b36c8f6d-5c40-4042-8fe1-efe3374de254 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] 10.222.0.48 "GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a" status: 200 len: 1549 microversion: 2.1 time: 0.161586 Jul 21 10:54:50.482754 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 492/997] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:54:50 2022] GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a => generated 1549 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:54:50.499217 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-b6d00f87-f1e8-413d-9948-5f167567b8cb tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:54:50.499726 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-b6d00f87-f1e8-413d-9948-5f167567b8cb tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] [instance: 5ec19443-8399-4f5f-b530-179ac8488e8a] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:54:50.506132 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b6d00f87-f1e8-413d-9948-5f167567b8cb tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:50.506598 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b6d00f87-f1e8-413d-9948-5f167567b8cb tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:50.507368 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b6d00f87-f1e8-413d-9948-5f167567b8cb tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:50.507806 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b6d00f87-f1e8-413d-9948-5f167567b8cb tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:50.602241 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-b6d00f87-f1e8-413d-9948-5f167567b8cb tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] 10.222.0.48 "GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.106896 Jul 21 10:54:50.603701 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 506/998] 10.222.0.48 () {58 vars in 1274 bytes} [Thu Jul 21 10:54:50 2022] GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a/os-interface => generated 285 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:54:51.942220 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [req-845c9628-1786-4624-a646-a4d084573c4d req-c0f94c47-c5da-4202-bac2-4d7424c94116 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ec19443-8399-4f5f-b530-179ac8488e8a", "tag": "9413091b-0c11-431b-a541-d2ab3dd8bc2f"}]} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:54:51.952559 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-845c9628-1786-4624-a646-a4d084573c4d req-c0f94c47-c5da-4202-bac2-4d7424c94116 service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:54:51.953093 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-845c9628-1786-4624-a646-a4d084573c4d req-c0f94c47-c5da-4202-bac2-4d7424c94116 service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:54:51.966797 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.compute.server_external_events [req-845c9628-1786-4624-a646-a4d084573c4d req-c0f94c47-c5da-4202-bac2-4d7424c94116 service nova] Creating event network-changed:9413091b-0c11-431b-a541-d2ab3dd8bc2f for instance 5ec19443-8399-4f5f-b530-179ac8488e8a on hv-cinder-84980 Jul 21 10:54:51.973190 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [req-845c9628-1786-4624-a646-a4d084573c4d req-c0f94c47-c5da-4202-bac2-4d7424c94116 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034280 Jul 21 10:54:51.974053 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 493/999] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 21 10:54:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:55:09.369573 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:55:09.370809 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:55:09.374587 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-bf96cc7c-b8b1-4885-baf4-8b5f1b3b60e9 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:55:09.380651 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-bf96cc7c-b8b1-4885-baf4-8b5f1b3b60e9 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] [instance: eb24f843-eeb3-43dd-bd48-3bcf68e344cd] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:55:09.380803 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [req-006b7c2a-47c7-453c-a2b9-30a4e030250e req-fade2c69-bf9f-4c91-9d62-0b8312b7fbf9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb24f843-eeb3-43dd-bd48-3bcf68e344cd", "tag": "2741d1f0-6bcb-4bee-8842-bc9bf8bc4db2"}]} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:55:09.382209 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-bf96cc7c-b8b1-4885-baf4-8b5f1b3b60e9 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:55:09.383250 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-bf96cc7c-b8b1-4885-baf4-8b5f1b3b60e9 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:55:09.384202 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-bf96cc7c-b8b1-4885-baf4-8b5f1b3b60e9 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:55:09.384796 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-bf96cc7c-b8b1-4885-baf4-8b5f1b3b60e9 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:55:09.391908 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_api:SELECT=23 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:55:09.393684 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell1:SELECT=70 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:55:09.398491 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-006b7c2a-47c7-453c-a2b9-30a4e030250e req-fade2c69-bf9f-4c91-9d62-0b8312b7fbf9 service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:55:09.399037 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-006b7c2a-47c7-453c-a2b9-30a4e030250e req-fade2c69-bf9f-4c91-9d62-0b8312b7fbf9 service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:55:09.413619 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-bf96cc7c-b8b1-4885-baf4-8b5f1b3b60e9 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] [instance: eb24f843-eeb3-43dd-bd48-3bcf68e344cd] Going to try to terminate instance {{(pid=124867) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 10:55:09.418154 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.compute.server_external_events [req-006b7c2a-47c7-453c-a2b9-30a4e030250e req-fade2c69-bf9f-4c91-9d62-0b8312b7fbf9 service nova] Creating event network-changed:2741d1f0-6bcb-4bee-8842-bc9bf8bc4db2 for instance eb24f843-eeb3-43dd-bd48-3bcf68e344cd on hv-cinder-84980 Jul 21 10:55:09.425809 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [req-006b7c2a-47c7-453c-a2b9-30a4e030250e req-fade2c69-bf9f-4c91-9d62-0b8312b7fbf9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052117 Jul 21 10:55:09.426990 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 494/1000] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 21 10:55:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:55:09.677376 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-bf96cc7c-b8b1-4885-baf4-8b5f1b3b60e9 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] 10.222.0.48 "DELETE /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd" status: 204 len: 0 microversion: 2.1 time: 0.308649 Jul 21 10:55:09.677973 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 507/1001] 10.222.0.48 () {58 vars in 1238 bytes} [Thu Jul 21 10:55:09 2022] DELETE /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 10:55:09.688781 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-95d82c35-d967-4aaa-b301-f8abb15264b3 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:55:09.689645 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-95d82c35-d967-4aaa-b301-f8abb15264b3 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] [instance: eb24f843-eeb3-43dd-bd48-3bcf68e344cd] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:55:09.697845 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-95d82c35-d967-4aaa-b301-f8abb15264b3 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:55:09.698670 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-95d82c35-d967-4aaa-b301-f8abb15264b3 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:55:09.700514 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-95d82c35-d967-4aaa-b301-f8abb15264b3 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:55:09.701133 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-95d82c35-d967-4aaa-b301-f8abb15264b3 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:55:09.859541 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-95d82c35-d967-4aaa-b301-f8abb15264b3 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e3fd195fd14b009ba56950dc542cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620ea9c4eaa74dc5858cf93d9fcad9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:55:09.867238 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-95d82c35-d967-4aaa-b301-f8abb15264b3 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] 10.222.0.48 "GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd" status: 200 len: 1570 microversion: 2.1 time: 0.184386 Jul 21 10:55:09.868356 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 495/1002] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:55:09 2022] GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd => generated 1570 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:55:10.885861 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-b0f7e652-2d36-4340-87d6-6186cdce9115 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:55:10.889839 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-b0f7e652-2d36-4340-87d6-6186cdce9115 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] [instance: eb24f843-eeb3-43dd-bd48-3bcf68e344cd] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:55:10.894693 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b0f7e652-2d36-4340-87d6-6186cdce9115 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:55:10.895528 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b0f7e652-2d36-4340-87d6-6186cdce9115 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:55:10.896462 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b0f7e652-2d36-4340-87d6-6186cdce9115 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:55:10.897112 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b0f7e652-2d36-4340-87d6-6186cdce9115 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:55:11.032012 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-b0f7e652-2d36-4340-87d6-6186cdce9115 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e3fd195fd14b009ba56950dc542cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620ea9c4eaa74dc5858cf93d9fcad9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:55:11.039650 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-b0f7e652-2d36-4340-87d6-6186cdce9115 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] 10.222.0.48 "GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd" status: 200 len: 1570 microversion: 2.1 time: 0.158089 Jul 21 10:55:11.040220 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 508/1003] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:55:10 2022] GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd => generated 1570 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:55:11.959033 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [req-bccd3f94-5f8d-4aae-8709-6da33b4ab961 req-225b5309-6719-4e3f-998c-4587457e0968 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb24f843-eeb3-43dd-bd48-3bcf68e344cd", "name": "network-vif-deleted", "tag": "2741d1f0-6bcb-4bee-8842-bc9bf8bc4db2"}]} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:55:11.968697 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-bccd3f94-5f8d-4aae-8709-6da33b4ab961 req-225b5309-6719-4e3f-998c-4587457e0968 service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:55:11.969165 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-bccd3f94-5f8d-4aae-8709-6da33b4ab961 req-225b5309-6719-4e3f-998c-4587457e0968 service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:55:11.980165 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.compute.server_external_events [req-bccd3f94-5f8d-4aae-8709-6da33b4ab961 req-225b5309-6719-4e3f-998c-4587457e0968 service nova] Creating event network-vif-deleted:2741d1f0-6bcb-4bee-8842-bc9bf8bc4db2 for instance eb24f843-eeb3-43dd-bd48-3bcf68e344cd on hv-cinder-84980 Jul 21 10:55:11.985262 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [req-bccd3f94-5f8d-4aae-8709-6da33b4ab961 req-225b5309-6719-4e3f-998c-4587457e0968 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029813 Jul 21 10:55:11.986129 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 496/1004] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 21 10:55:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 10:55:12.057848 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-302d8361-fec2-44dc-89df-7050604e7fe2 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:55:12.059692 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-302d8361-fec2-44dc-89df-7050604e7fe2 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] [instance: eb24f843-eeb3-43dd-bd48-3bcf68e344cd] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:55:12.066103 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-302d8361-fec2-44dc-89df-7050604e7fe2 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:55:12.066564 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-302d8361-fec2-44dc-89df-7050604e7fe2 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:55:12.067388 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-302d8361-fec2-44dc-89df-7050604e7fe2 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:55:12.067824 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-302d8361-fec2-44dc-89df-7050604e7fe2 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:55:12.135635 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-302d8361-fec2-44dc-89df-7050604e7fe2 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e3fd195fd14b009ba56950dc542cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620ea9c4eaa74dc5858cf93d9fcad9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:55:12.143854 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-302d8361-fec2-44dc-89df-7050604e7fe2 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] 10.222.0.48 "GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd" status: 200 len: 1383 microversion: 2.1 time: 0.089777 Jul 21 10:55:12.144423 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 509/1005] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:55:12 2022] GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd => generated 1383 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:55:13.162991 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-3a4bd03d-7108-41f6-ad22-ab29ecaff4a8 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:55:13.164121 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-3a4bd03d-7108-41f6-ad22-ab29ecaff4a8 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] [instance: eb24f843-eeb3-43dd-bd48-3bcf68e344cd] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:55:13.171284 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3a4bd03d-7108-41f6-ad22-ab29ecaff4a8 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:55:13.171795 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3a4bd03d-7108-41f6-ad22-ab29ecaff4a8 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:55:13.172586 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3a4bd03d-7108-41f6-ad22-ab29ecaff4a8 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:55:13.173018 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3a4bd03d-7108-41f6-ad22-ab29ecaff4a8 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:55:13.211038 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3a4bd03d-7108-41f6-ad22-ab29ecaff4a8 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:55:13.211582 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3a4bd03d-7108-41f6-ad22-ab29ecaff4a8 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:55:13.212095 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.objects.instance [None req-3a4bd03d-7108-41f6-ad22-ab29ecaff4a8 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lazy-loading 'fault' on Instance uuid eb24f843-eeb3-43dd-bd48-3bcf68e344cd {{(pid=124868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 10:55:13.258905 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-3a4bd03d-7108-41f6-ad22-ab29ecaff4a8 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e3fd195fd14b009ba56950dc542cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620ea9c4eaa74dc5858cf93d9fcad9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:55:13.266887 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-3a4bd03d-7108-41f6-ad22-ab29ecaff4a8 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] 10.222.0.48 "GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd" status: 200 len: 1224 microversion: 2.1 time: 0.108767 Jul 21 10:55:13.267566 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 497/1006] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:55:13 2022] GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd => generated 1224 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:55:14.284441 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-b2fd3f3b-99d9-4403-99d1-9b72354b6fad tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:55:14.284975 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-b2fd3f3b-99d9-4403-99d1-9b72354b6fad tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] [instance: eb24f843-eeb3-43dd-bd48-3bcf68e344cd] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:55:14.291484 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b2fd3f3b-99d9-4403-99d1-9b72354b6fad tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:55:14.292071 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b2fd3f3b-99d9-4403-99d1-9b72354b6fad tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:55:14.292851 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b2fd3f3b-99d9-4403-99d1-9b72354b6fad tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:55:14.293941 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b2fd3f3b-99d9-4403-99d1-9b72354b6fad tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:55:14.307556 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.wsgi [None req-b2fd3f3b-99d9-4403-99d1-9b72354b6fad tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] HTTP exception thrown: Instance eb24f843-eeb3-43dd-bd48-3bcf68e344cd could not be found. Jul 21 10:55:14.313079 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-b2fd3f3b-99d9-4403-99d1-9b72354b6fad tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Request method failure captured: Jul 21 10:55:14.313079 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: request: GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd HTTP/1.1 Jul 21 10:55:14.313079 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Accept: application/json Jul 21 10:55:14.313079 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Accept-Encoding: identity Jul 21 10:55:14.313079 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Connection: close Jul 21 10:55:14.313079 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Content-Length: 0 Jul 21 10:55:14.313079 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Content-Type: application/json Jul 21 10:55:14.313079 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Host: 10.222.0.48 Jul 21 10:55:14.313079 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Openstack-System-Scope: None Jul 21 10:55:14.313079 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: User-Agent: python-urllib3/1.26.9 Jul 21 10:55:14.313079 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Auth-Token: gAAAAABi2S8jWuxQWXi1t0S6KwhrSaHFYMmykKa5V2Dd9jQ6NvoOic-1IazhR4-9xW8QVEaLU7mExzb_aFLidSIX9rVOhqOhgKXylDRMHSMGtoIxXxxoYqVBK0a_MJ0m6SFeuVxkNFRInFZEwJySAHj8d-l7NK1D2cpEoYlxe7oe4z4QZfI7g_8 Jul 21 10:55:14.313079 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Domain-Id: None Jul 21 10:55:14.313079 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Domain-Name: None Jul 21 10:55:14.313079 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Identity-Status: Confirmed Jul 21 10:55:14.313079 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Is-Admin-Project: True Jul 21 10:55:14.313079 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Project-Domain-Id: default Jul 21 10:55:14.313079 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Project-Domain-Name: Default Jul 21 10:55:14.313079 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Project-Id: 620ea9c4eaa74dc5858cf93d9fcad9f1 Jul 21 10:55:14.313079 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Project-Name: tempest-TestShelveInstance-987642791 Jul 21 10:55:14.313079 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Role: reader,member Jul 21 10:55:14.313079 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Roles: reader,member Jul 21 10:55:14.314831 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/620ea9c4eaa74dc5858cf93d9fcad9f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/620ea9c4eaa74dc5858cf93d9fcad9f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/620ea9c4eaa74dc5858cf93d9fcad9f1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_620ea9c4eaa74dc5858cf93d9fcad9f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] Jul 21 10:55:14.314831 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Tenant: tempest-TestShelveInstance-987642791 Jul 21 10:55:14.314831 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Tenant-Id: 620ea9c4eaa74dc5858cf93d9fcad9f1 Jul 21 10:55:14.314831 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Tenant-Name: tempest-TestShelveInstance-987642791 Jul 21 10:55:14.314831 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User: tempest-TestShelveInstance-987642791-project Jul 21 10:55:14.314831 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User-Domain-Id: default Jul 21 10:55:14.314831 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User-Domain-Name: Default Jul 21 10:55:14.314831 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User-Id: e2e3fd195fd14b009ba56950dc542cb1 Jul 21 10:55:14.314831 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User-Name: tempest-TestShelveInstance-987642791-project Jul 21 10:55:14.314831 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: method: > Jul 21 10:55:14.314831 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: exception: Instance eb24f843-eeb3-43dd-bd48-3bcf68e344cd could not be found. Jul 21 10:55:14.314831 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: action_args: {'id': 'eb24f843-eeb3-43dd-bd48-3bcf68e344cd'} Jul 21 10:55:14.315874 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 10:55:14.315874 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:55:14.315874 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 10:55:14.315874 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 10:55:14.315874 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 10:55:14.315874 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 10:55:14.315874 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 10:55:14.315874 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 10:55:14.315874 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 10:55:14.315874 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 10:55:14.315874 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb24f843-eeb3-43dd-bd48-3bcf68e344cd could not be found. Jul 21 10:55:14.315874 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:55:14.315874 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:55:14.315874 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:55:14.315874 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:55:14.315874 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:55:14.315874 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:55:14.315874 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 10:55:14.315874 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 10:55:14.315874 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 10:55:14.318298 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 10:55:14.318298 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 10:55:14.318298 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 10:55:14.318298 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 10:55:14.318298 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 10:55:14.318298 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 10:55:14.318298 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 10:55:14.318298 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb24f843-eeb3-43dd-bd48-3bcf68e344cd could not be found. Jul 21 10:55:14.318298 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:55:14.318298 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:55:14.318298 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:55:14.318298 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:55:14.318298 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:55:14.318298 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:55:14.318298 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 10:55:14.318298 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 10:55:14.318298 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb24f843-eeb3-43dd-bd48-3bcf68e344cd could not be found. Jul 21 10:55:14.318298 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:55:14.319916 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-b2fd3f3b-99d9-4403-99d1-9b72354b6fad tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Returning 404 to user: Instance eb24f843-eeb3-43dd-bd48-3bcf68e344cd could not be found. {{(pid=124867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 10:55:14.319916 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-b2fd3f3b-99d9-4403-99d1-9b72354b6fad tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] 10.222.0.48 "GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd" status: 404 len: 111 microversion: 2.1 time: 0.030733 Jul 21 10:55:14.319916 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 510/1007] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:55:14 2022] GET /compute/v2.1/servers/eb24f843-eeb3-43dd-bd48-3bcf68e344cd => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 10:55:14.530373 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-ed207ea7-66f3-47f1-8e5b-ea8e7348cde1 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] Calling method '.version_select at 0x7f7962ba4700>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:55:14.632228 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-ed207ea7-66f3-47f1-8e5b-ea8e7348cde1 tempest-TestShelveInstance-987642791 tempest-TestShelveInstance-987642791-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1816234042" status: 202 len: 0 microversion: 2.1 time: 0.106636 Jul 21 10:55:14.632859 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 498/1008] 10.222.0.48 () {58 vars in 1253 bytes} [Thu Jul 21 10:55:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1816234042 => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 21 10:55:27.709438 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-8526b25e-0d2b-4b90-8944-cb392c585f84 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:55:27.716874 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-8526b25e-0d2b-4b90-8944-cb392c585f84 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] [instance: 5ec19443-8399-4f5f-b530-179ac8488e8a] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:55:27.716874 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:55:27.716874 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:55:27.719860 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8526b25e-0d2b-4b90-8944-cb392c585f84 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:55:27.720303 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8526b25e-0d2b-4b90-8944-cb392c585f84 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:55:27.721069 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8526b25e-0d2b-4b90-8944-cb392c585f84 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:55:27.721498 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8526b25e-0d2b-4b90-8944-cb392c585f84 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:55:27.748990 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-8526b25e-0d2b-4b90-8944-cb392c585f84 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] 10.222.0.48 "GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a/ips" status: 200 len: 146 microversion: 2.1 time: 0.044607 Jul 21 10:55:27.750581 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 511/1009] 10.222.0.48 () {58 vars in 1247 bytes} [Thu Jul 21 10:55:27 2022] GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a/ips => generated 146 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:55:30.497949 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-62cb0d66-53e6-4d7c-830f-4bff20e468ad tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7332af35-fc27-4b3c-8c29-919ca2b2b5cc"}} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:55:30.499078 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-62cb0d66-53e6-4d7c-830f-4bff20e468ad tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] [instance: 5ec19443-8399-4f5f-b530-179ac8488e8a] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:55:30.503195 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell1:SELECT=18 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:55:30.504128 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:55:30.510157 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-62cb0d66-53e6-4d7c-830f-4bff20e468ad tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:55:30.514736 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-62cb0d66-53e6-4d7c-830f-4bff20e468ad tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:55:30.514736 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-62cb0d66-53e6-4d7c-830f-4bff20e468ad tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:55:30.514736 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-62cb0d66-53e6-4d7c-830f-4bff20e468ad tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:55:31.349132 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-62cb0d66-53e6-4d7c-830f-4bff20e468ad tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] 10.222.0.48 "POST /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.856034 Jul 21 10:55:31.349747 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 499/1010] 10.222.0.48 () {60 vars in 1322 bytes} [Thu Jul 21 10:55:30 2022] POST /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a/os-volume_attachments => generated 194 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:55:36.826317 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-7f43dfa9-1132-4bae-a56d-0efdaeae4a06 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Action: 'create', calling method: .version_select at 0x7f795ea36160>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-122371990", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCiuVW9QNc8koE262rCVWKIZUmcf/XAbpnM+zWLk0bTWlUdYJ2arw5xJgd9QSc2IuY36BYLSfL5AmDJ9YBAimOcEF+nwX+y5Rm9wKkDnEJsH1gyt0pmR1rU5QXDBD6cjeQ=="}} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:55:36.842502 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.quota [None req-7f43dfa9-1132-4bae-a56d-0efdaeae4a06 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Getting quotas for project c99e5deac07a429c9c771ef41d278a46. Resources: {'key_pairs'} {{(pid=124867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 10:55:36.846980 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.quota [None req-7f43dfa9-1132-4bae-a56d-0efdaeae4a06 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Getting quotas for user a0aebc4614c448bdb77fb167d4ae3de1 and project c99e5deac07a429c9c771ef41d278a46. Resources: {'key_pairs'} {{(pid=124867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 10:55:36.946013 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-7f43dfa9-1132-4bae-a56d-0efdaeae4a06 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.318284 Jul 21 10:55:36.947031 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 512/1011] 10.222.0.48 () {60 vars in 1158 bytes} [Thu Jul 21 10:55:36 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:55:38.914178 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-0e3dda0a-7dab-4552-8b33-3de26049a677 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:55:38.921458 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0e3dda0a-7dab-4552-8b33-3de26049a677 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:55:38.921835 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0e3dda0a-7dab-4552-8b33-3de26049a677 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:55:38.982725 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-0e3dda0a-7dab-4552-8b33-3de26049a677 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] [instance: 5ec19443-8399-4f5f-b530-179ac8488e8a] Going to try to stop instance {{(pid=124868) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 21 10:55:39.199386 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-0e3dda0a-7dab-4552-8b33-3de26049a677 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] 10.222.0.48 "POST /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a/action" status: 202 len: 0 microversion: 2.1 time: 0.289119 Jul 21 10:55:39.200582 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 500/1012] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 21 10:55:38 2022] POST /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a/action => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 10:55:39.209431 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-012ccfe6-e0f0-4f76-9e06-29e14be99f27 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:55:39.210524 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-012ccfe6-e0f0-4f76-9e06-29e14be99f27 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] [instance: 5ec19443-8399-4f5f-b530-179ac8488e8a] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:55:39.220179 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-012ccfe6-e0f0-4f76-9e06-29e14be99f27 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:55:39.223626 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-012ccfe6-e0f0-4f76-9e06-29e14be99f27 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:55:39.224706 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-012ccfe6-e0f0-4f76-9e06-29e14be99f27 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:55:39.225378 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-012ccfe6-e0f0-4f76-9e06-29e14be99f27 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:55:39.394524 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-012ccfe6-e0f0-4f76-9e06-29e14be99f27 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d76fa94b5ff4721bf490efd0699688e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3ae8ed116141658017f823c633c2f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:55:39.403721 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-012ccfe6-e0f0-4f76-9e06-29e14be99f27 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] 10.222.0.48 "GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a" status: 200 len: 1723 microversion: 2.1 time: 0.198125 Jul 21 10:55:39.404661 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 513/1013] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:55:39 2022] GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a => generated 1723 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:55:40.422048 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-c3e4a8a3-c85c-4cbe-ab56-0d90d4efa7a2 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:55:40.422834 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-c3e4a8a3-c85c-4cbe-ab56-0d90d4efa7a2 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] [instance: 5ec19443-8399-4f5f-b530-179ac8488e8a] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:55:40.429823 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c3e4a8a3-c85c-4cbe-ab56-0d90d4efa7a2 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:55:40.430287 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c3e4a8a3-c85c-4cbe-ab56-0d90d4efa7a2 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:55:40.431099 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c3e4a8a3-c85c-4cbe-ab56-0d90d4efa7a2 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:55:40.431522 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-c3e4a8a3-c85c-4cbe-ab56-0d90d4efa7a2 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:55:40.574811 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-c3e4a8a3-c85c-4cbe-ab56-0d90d4efa7a2 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d76fa94b5ff4721bf490efd0699688e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3ae8ed116141658017f823c633c2f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:55:40.582795 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-c3e4a8a3-c85c-4cbe-ab56-0d90d4efa7a2 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] 10.222.0.48 "GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a" status: 200 len: 1723 microversion: 2.1 time: 0.165095 Jul 21 10:55:40.583371 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 501/1014] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:55:40 2022] GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:55:41.600606 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-247b2520-bbfc-4770-9cb8-e0078c62b5b8 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:55:41.601170 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-247b2520-bbfc-4770-9cb8-e0078c62b5b8 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] [instance: 5ec19443-8399-4f5f-b530-179ac8488e8a] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:55:41.607560 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-247b2520-bbfc-4770-9cb8-e0078c62b5b8 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:55:41.608000 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-247b2520-bbfc-4770-9cb8-e0078c62b5b8 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:55:41.608746 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-247b2520-bbfc-4770-9cb8-e0078c62b5b8 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:55:41.609174 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-247b2520-bbfc-4770-9cb8-e0078c62b5b8 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:55:41.742036 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-247b2520-bbfc-4770-9cb8-e0078c62b5b8 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d76fa94b5ff4721bf490efd0699688e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3ae8ed116141658017f823c633c2f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:55:41.749892 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-247b2520-bbfc-4770-9cb8-e0078c62b5b8 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] 10.222.0.48 "GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a" status: 200 len: 1723 microversion: 2.1 time: 0.153222 Jul 21 10:55:41.750476 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 514/1015] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:55:41 2022] GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:55:42.767402 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-ca3a97e2-c42c-4721-aeac-304c7c6c861a tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:55:42.768037 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-ca3a97e2-c42c-4721-aeac-304c7c6c861a tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] [instance: 5ec19443-8399-4f5f-b530-179ac8488e8a] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:55:42.774605 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ca3a97e2-c42c-4721-aeac-304c7c6c861a tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:55:42.775058 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ca3a97e2-c42c-4721-aeac-304c7c6c861a tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:55:42.775850 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ca3a97e2-c42c-4721-aeac-304c7c6c861a tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:55:42.776289 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ca3a97e2-c42c-4721-aeac-304c7c6c861a tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:55:42.915551 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-ca3a97e2-c42c-4721-aeac-304c7c6c861a tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d76fa94b5ff4721bf490efd0699688e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3ae8ed116141658017f823c633c2f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:55:42.924068 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-ca3a97e2-c42c-4721-aeac-304c7c6c861a tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] 10.222.0.48 "GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a" status: 200 len: 1723 microversion: 2.1 time: 0.161496 Jul 21 10:55:42.924673 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 502/1016] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:55:42 2022] GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:55:43.943135 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-73d4304a-6e8f-4f8d-9497-e58e748a4c64 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:55:43.943747 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-73d4304a-6e8f-4f8d-9497-e58e748a4c64 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] [instance: 5ec19443-8399-4f5f-b530-179ac8488e8a] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:55:43.950281 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-73d4304a-6e8f-4f8d-9497-e58e748a4c64 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:55:43.950767 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-73d4304a-6e8f-4f8d-9497-e58e748a4c64 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:55:43.951528 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-73d4304a-6e8f-4f8d-9497-e58e748a4c64 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:55:43.951957 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-73d4304a-6e8f-4f8d-9497-e58e748a4c64 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:55:44.091365 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-73d4304a-6e8f-4f8d-9497-e58e748a4c64 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d76fa94b5ff4721bf490efd0699688e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3ae8ed116141658017f823c633c2f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:55:44.099768 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-73d4304a-6e8f-4f8d-9497-e58e748a4c64 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] 10.222.0.48 "GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a" status: 200 len: 1723 microversion: 2.1 time: 0.161577 Jul 21 10:55:44.100328 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 515/1017] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:55:43 2022] GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:55:45.116976 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-e7c1e57f-51f7-4d73-bd41-70a6775c37bd tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:55:45.117591 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-e7c1e57f-51f7-4d73-bd41-70a6775c37bd tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] [instance: 5ec19443-8399-4f5f-b530-179ac8488e8a] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:55:45.124352 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e7c1e57f-51f7-4d73-bd41-70a6775c37bd tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:55:45.124806 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e7c1e57f-51f7-4d73-bd41-70a6775c37bd tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:55:45.126116 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e7c1e57f-51f7-4d73-bd41-70a6775c37bd tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:55:45.126535 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e7c1e57f-51f7-4d73-bd41-70a6775c37bd tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:55:45.261097 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-e7c1e57f-51f7-4d73-bd41-70a6775c37bd tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d76fa94b5ff4721bf490efd0699688e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3ae8ed116141658017f823c633c2f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:55:45.269159 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-e7c1e57f-51f7-4d73-bd41-70a6775c37bd tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] 10.222.0.48 "GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a" status: 200 len: 1723 microversion: 2.1 time: 0.155985 Jul 21 10:55:45.269718 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 503/1018] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:55:45 2022] GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:55:46.286312 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-cd0a7aa5-3c2c-4028-81fe-4bd4a2dceebe tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:55:46.286938 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-cd0a7aa5-3c2c-4028-81fe-4bd4a2dceebe tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] [instance: 5ec19443-8399-4f5f-b530-179ac8488e8a] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:55:46.293366 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-cd0a7aa5-3c2c-4028-81fe-4bd4a2dceebe tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:55:46.293808 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-cd0a7aa5-3c2c-4028-81fe-4bd4a2dceebe tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:55:46.294566 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-cd0a7aa5-3c2c-4028-81fe-4bd4a2dceebe tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:55:46.295004 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-cd0a7aa5-3c2c-4028-81fe-4bd4a2dceebe tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:55:46.450202 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-cd0a7aa5-3c2c-4028-81fe-4bd4a2dceebe tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d76fa94b5ff4721bf490efd0699688e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3ae8ed116141658017f823c633c2f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:55:46.459660 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-cd0a7aa5-3c2c-4028-81fe-4bd4a2dceebe tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] 10.222.0.48 "GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a" status: 200 len: 1723 microversion: 2.1 time: 0.178186 Jul 21 10:55:46.460732 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 516/1019] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:55:46 2022] GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:55:47.480640 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-416b7a64-3e52-4848-bf80-768855983cd6 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:55:47.481205 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-416b7a64-3e52-4848-bf80-768855983cd6 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] [instance: 5ec19443-8399-4f5f-b530-179ac8488e8a] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:55:47.488024 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-416b7a64-3e52-4848-bf80-768855983cd6 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:55:47.488475 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-416b7a64-3e52-4848-bf80-768855983cd6 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:55:47.489242 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-416b7a64-3e52-4848-bf80-768855983cd6 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:55:47.489680 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-416b7a64-3e52-4848-bf80-768855983cd6 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:55:47.623997 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-416b7a64-3e52-4848-bf80-768855983cd6 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d76fa94b5ff4721bf490efd0699688e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3ae8ed116141658017f823c633c2f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:55:47.632968 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-416b7a64-3e52-4848-bf80-768855983cd6 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] 10.222.0.48 "GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a" status: 200 len: 1723 microversion: 2.1 time: 0.157465 Jul 21 10:55:47.638039 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 504/1020] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:55:47 2022] GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:55:48.652574 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-b73b5942-7d95-4524-a4f2-a2287aa734e7 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:55:48.653106 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-b73b5942-7d95-4524-a4f2-a2287aa734e7 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] [instance: 5ec19443-8399-4f5f-b530-179ac8488e8a] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:55:48.654912 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell0:SELECT=4 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:55:48.660580 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b73b5942-7d95-4524-a4f2-a2287aa734e7 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:55:48.661024 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b73b5942-7d95-4524-a4f2-a2287aa734e7 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:55:48.661929 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b73b5942-7d95-4524-a4f2-a2287aa734e7 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:55:48.662385 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b73b5942-7d95-4524-a4f2-a2287aa734e7 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:55:48.801122 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-b73b5942-7d95-4524-a4f2-a2287aa734e7 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d76fa94b5ff4721bf490efd0699688e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3ae8ed116141658017f823c633c2f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:55:48.809036 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-b73b5942-7d95-4524-a4f2-a2287aa734e7 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] 10.222.0.48 "GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a" status: 200 len: 1723 microversion: 2.1 time: 0.160382 Jul 21 10:55:48.809588 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 517/1021] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:55:48 2022] GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:55:49.826795 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-f8c87994-fb0c-4da5-a030-0a9b9a777d6f tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:55:49.827420 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-f8c87994-fb0c-4da5-a030-0a9b9a777d6f tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] [instance: 5ec19443-8399-4f5f-b530-179ac8488e8a] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:55:49.835171 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f8c87994-fb0c-4da5-a030-0a9b9a777d6f tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:55:49.835927 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f8c87994-fb0c-4da5-a030-0a9b9a777d6f tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:55:49.836734 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f8c87994-fb0c-4da5-a030-0a9b9a777d6f tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:55:49.837174 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f8c87994-fb0c-4da5-a030-0a9b9a777d6f tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:55:49.966471 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-f8c87994-fb0c-4da5-a030-0a9b9a777d6f tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d76fa94b5ff4721bf490efd0699688e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3ae8ed116141658017f823c633c2f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:55:49.974703 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-f8c87994-fb0c-4da5-a030-0a9b9a777d6f tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] 10.222.0.48 "GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a" status: 200 len: 1723 microversion: 2.1 time: 0.151872 Jul 21 10:55:49.975263 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 505/1022] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:55:49 2022] GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:55:50.991993 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-0540ee6d-36a6-4286-b998-594c4c98cadd tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:55:50.992627 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-0540ee6d-36a6-4286-b998-594c4c98cadd tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] [instance: 5ec19443-8399-4f5f-b530-179ac8488e8a] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:55:50.999132 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0540ee6d-36a6-4286-b998-594c4c98cadd tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:55:50.999573 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0540ee6d-36a6-4286-b998-594c4c98cadd tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:55:51.000856 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0540ee6d-36a6-4286-b998-594c4c98cadd tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:55:51.001300 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0540ee6d-36a6-4286-b998-594c4c98cadd tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:55:51.127941 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-0540ee6d-36a6-4286-b998-594c4c98cadd tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d76fa94b5ff4721bf490efd0699688e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3ae8ed116141658017f823c633c2f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:55:51.135830 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-0540ee6d-36a6-4286-b998-594c4c98cadd tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] 10.222.0.48 "GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a" status: 200 len: 1723 microversion: 2.1 time: 0.147653 Jul 21 10:55:51.136401 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 518/1023] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:55:50 2022] GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:55:52.153364 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-baadb93e-e275-4fdb-95f2-d408907f607b tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:55:52.153878 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-baadb93e-e275-4fdb-95f2-d408907f607b tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] [instance: 5ec19443-8399-4f5f-b530-179ac8488e8a] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:55:52.160548 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-baadb93e-e275-4fdb-95f2-d408907f607b tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:55:52.160997 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-baadb93e-e275-4fdb-95f2-d408907f607b tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:55:52.161750 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-baadb93e-e275-4fdb-95f2-d408907f607b tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:55:52.162178 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-baadb93e-e275-4fdb-95f2-d408907f607b tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:55:52.294645 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-baadb93e-e275-4fdb-95f2-d408907f607b tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d76fa94b5ff4721bf490efd0699688e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3ae8ed116141658017f823c633c2f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:55:52.303156 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-baadb93e-e275-4fdb-95f2-d408907f607b tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] 10.222.0.48 "GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a" status: 200 len: 1723 microversion: 2.1 time: 0.153732 Jul 21 10:55:52.303716 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 506/1024] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:55:52 2022] GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:55:53.319836 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-f1abd505-69fd-4f78-8f7d-fa9d0a73423d tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:55:53.320437 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-f1abd505-69fd-4f78-8f7d-fa9d0a73423d tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] [instance: 5ec19443-8399-4f5f-b530-179ac8488e8a] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:55:53.326938 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f1abd505-69fd-4f78-8f7d-fa9d0a73423d tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:55:53.327383 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f1abd505-69fd-4f78-8f7d-fa9d0a73423d tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:55:53.328281 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f1abd505-69fd-4f78-8f7d-fa9d0a73423d tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:55:53.329739 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f1abd505-69fd-4f78-8f7d-fa9d0a73423d tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:55:53.461398 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-f1abd505-69fd-4f78-8f7d-fa9d0a73423d tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d76fa94b5ff4721bf490efd0699688e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3ae8ed116141658017f823c633c2f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:55:53.469551 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-f1abd505-69fd-4f78-8f7d-fa9d0a73423d tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] 10.222.0.48 "GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a" status: 200 len: 1723 microversion: 2.1 time: 0.153426 Jul 21 10:55:53.470110 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 519/1025] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:55:53 2022] GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:55:54.486501 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-0568b886-a578-4dea-aa0c-bf8e75709cc8 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:55:54.487172 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-0568b886-a578-4dea-aa0c-bf8e75709cc8 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] [instance: 5ec19443-8399-4f5f-b530-179ac8488e8a] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:55:54.493850 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0568b886-a578-4dea-aa0c-bf8e75709cc8 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:55:54.494301 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0568b886-a578-4dea-aa0c-bf8e75709cc8 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:55:54.495094 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0568b886-a578-4dea-aa0c-bf8e75709cc8 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:55:54.495577 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-0568b886-a578-4dea-aa0c-bf8e75709cc8 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:55:54.628054 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-0568b886-a578-4dea-aa0c-bf8e75709cc8 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d76fa94b5ff4721bf490efd0699688e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3ae8ed116141658017f823c633c2f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:55:54.635978 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-0568b886-a578-4dea-aa0c-bf8e75709cc8 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] 10.222.0.48 "GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a" status: 200 len: 1723 microversion: 2.1 time: 0.153442 Jul 21 10:55:54.636548 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 507/1026] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:55:54 2022] GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:55:55.146597 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-54fc2a8d-dd44-40e2-95d5-5fe9ed894ba2 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1951938845", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-122371990", "security_groups": [{"name": "tempest-secgroup-smoke-926775298"}], "block_device_mapping_v2": [{"uuid": "8b7ec756-17d0-41fd-8d45-0656cac90a9a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "cc0b2a51-d561-47c8-bdc0-392c408f6063"}]}} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:55:55.258696 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.network.neutron [None req-54fc2a8d-dd44-40e2-95d5-5fe9ed894ba2 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] validate_networks() for [('cc0b2a51-d561-47c8-bdc0-392c408f6063', None, None, None, None, None)] {{(pid=124867) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 10:55:55.624590 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-54fc2a8d-dd44-40e2-95d5-5fe9ed894ba2 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Flavor limits 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 10:55:55.625068 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-54fc2a8d-dd44-40e2-95d5-5fe9ed894ba2 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Image limits 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 10:55:55.625696 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-54fc2a8d-dd44-40e2-95d5-5fe9ed894ba2 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Flavor pref 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 10:55:55.626107 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-54fc2a8d-dd44-40e2-95d5-5fe9ed894ba2 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Image pref 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 10:55:55.626518 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-54fc2a8d-dd44-40e2-95d5-5fe9ed894ba2 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 10:55:55.635365 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-54fc2a8d-dd44-40e2-95d5-5fe9ed894ba2 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:55:55.635808 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-54fc2a8d-dd44-40e2-95d5-5fe9ed894ba2 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:55:55.636599 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-54fc2a8d-dd44-40e2-95d5-5fe9ed894ba2 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:55:55.637032 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-54fc2a8d-dd44-40e2-95d5-5fe9ed894ba2 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:55:55.653271 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-f531caa1-d7ac-48ad-9067-60f4b36b4898 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:55:55.653882 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-f531caa1-d7ac-48ad-9067-60f4b36b4898 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] [instance: 5ec19443-8399-4f5f-b530-179ac8488e8a] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:55:55.654371 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.quota [None req-54fc2a8d-dd44-40e2-95d5-5fe9ed894ba2 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Getting quotas for project c99e5deac07a429c9c771ef41d278a46. Resources: {'ram', 'instances', 'cores'} {{(pid=124867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 10:55:55.659140 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.quota [None req-54fc2a8d-dd44-40e2-95d5-5fe9ed894ba2 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Getting quotas for user a0aebc4614c448bdb77fb167d4ae3de1 and project c99e5deac07a429c9c771ef41d278a46. Resources: {'ram', 'instances', 'cores'} {{(pid=124867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 10:55:55.661083 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f531caa1-d7ac-48ad-9067-60f4b36b4898 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:55:55.661543 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f531caa1-d7ac-48ad-9067-60f4b36b4898 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:55:55.662311 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f531caa1-d7ac-48ad-9067-60f4b36b4898 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:55:55.662777 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f531caa1-d7ac-48ad-9067-60f4b36b4898 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:55:55.716404 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-54fc2a8d-dd44-40e2-95d5-5fe9ed894ba2 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Going to run 1 instances... {{(pid=124867) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 10:55:55.718473 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-54fc2a8d-dd44-40e2-95d5-5fe9ed894ba2 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] [instance: 6ef47e35-a90e-4c42-9bbc-1e09a85d7d0e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8b7ec756-17d0-41fd-8d45-0656cac90a9a',volume_size=None,volume_type=None)] {{(pid=124867) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 10:55:55.797177 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-f531caa1-d7ac-48ad-9067-60f4b36b4898 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d76fa94b5ff4721bf490efd0699688e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3ae8ed116141658017f823c633c2f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:55:55.805302 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-f531caa1-d7ac-48ad-9067-60f4b36b4898 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] 10.222.0.48 "GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a" status: 200 len: 1723 microversion: 2.1 time: 0.156040 Jul 21 10:55:55.805871 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 508/1027] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:55:55 2022] GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:55:56.098215 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-54fc2a8d-dd44-40e2-95d5-5fe9ed894ba2 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.955332 Jul 21 10:55:56.098892 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 520/1028] 10.222.0.48 () {60 vars in 1146 bytes} [Thu Jul 21 10:55:55 2022] POST /compute/v2.1/servers => generated 405 bytes in 957 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 10:55:56.108942 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-61680470-e647-4fbb-a541-0973b0e0e61c tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:55:56.109589 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-61680470-e647-4fbb-a541-0973b0e0e61c tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] [instance: 6ef47e35-a90e-4c42-9bbc-1e09a85d7d0e] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:55:56.171027 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-61680470-e647-4fbb-a541-0973b0e0e61c tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0aebc4614c448bdb77fb167d4ae3de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99e5deac07a429c9c771ef41d278a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:55:56.178030 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-61680470-e647-4fbb-a541-0973b0e0e61c tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] 10.222.0.48 "GET /compute/v2.1/servers/6ef47e35-a90e-4c42-9bbc-1e09a85d7d0e" status: 200 len: 1094 microversion: 2.1 time: 0.072968 Jul 21 10:55:56.178619 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 509/1029] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:55:56 2022] GET /compute/v2.1/servers/6ef47e35-a90e-4c42-9bbc-1e09a85d7d0e => generated 1094 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:55:56.821927 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-be034349-e8cb-47af-8e64-13ed7ab346d1 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:55:56.822589 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-be034349-e8cb-47af-8e64-13ed7ab346d1 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] [instance: 5ec19443-8399-4f5f-b530-179ac8488e8a] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:55:56.829814 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-be034349-e8cb-47af-8e64-13ed7ab346d1 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:55:56.830267 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-be034349-e8cb-47af-8e64-13ed7ab346d1 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:55:56.831068 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-be034349-e8cb-47af-8e64-13ed7ab346d1 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:55:56.831505 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-be034349-e8cb-47af-8e64-13ed7ab346d1 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:55:56.961965 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-be034349-e8cb-47af-8e64-13ed7ab346d1 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d76fa94b5ff4721bf490efd0699688e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3ae8ed116141658017f823c633c2f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:55:56.970676 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-be034349-e8cb-47af-8e64-13ed7ab346d1 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] 10.222.0.48 "GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a" status: 200 len: 1723 microversion: 2.1 time: 0.153155 Jul 21 10:55:56.971236 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 521/1030] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:55:56 2022] GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:55:57.195163 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-414e7976-0b44-4fb4-91cc-0f0749b13978 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:55:57.197349 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-414e7976-0b44-4fb4-91cc-0f0749b13978 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] [instance: 6ef47e35-a90e-4c42-9bbc-1e09a85d7d0e] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:55:57.202748 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-414e7976-0b44-4fb4-91cc-0f0749b13978 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:55:57.203832 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-414e7976-0b44-4fb4-91cc-0f0749b13978 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:55:57.204676 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-414e7976-0b44-4fb4-91cc-0f0749b13978 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:55:57.205107 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-414e7976-0b44-4fb4-91cc-0f0749b13978 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:55:57.264858 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-414e7976-0b44-4fb4-91cc-0f0749b13978 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0aebc4614c448bdb77fb167d4ae3de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99e5deac07a429c9c771ef41d278a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:55:57.272884 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-414e7976-0b44-4fb4-91cc-0f0749b13978 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] 10.222.0.48 "GET /compute/v2.1/servers/6ef47e35-a90e-4c42-9bbc-1e09a85d7d0e" status: 200 len: 1144 microversion: 2.1 time: 0.081691 Jul 21 10:55:57.273449 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 510/1031] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:55:57 2022] GET /compute/v2.1/servers/6ef47e35-a90e-4c42-9bbc-1e09a85d7d0e => generated 1144 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:55:57.987405 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-6ddd7968-0482-4aba-9a45-aabf31079f73 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:55:57.988031 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-6ddd7968-0482-4aba-9a45-aabf31079f73 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] [instance: 5ec19443-8399-4f5f-b530-179ac8488e8a] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:55:57.994830 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6ddd7968-0482-4aba-9a45-aabf31079f73 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:55:57.995289 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6ddd7968-0482-4aba-9a45-aabf31079f73 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:55:57.996060 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6ddd7968-0482-4aba-9a45-aabf31079f73 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:55:57.996496 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6ddd7968-0482-4aba-9a45-aabf31079f73 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:55:58.133177 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-6ddd7968-0482-4aba-9a45-aabf31079f73 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d76fa94b5ff4721bf490efd0699688e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3ae8ed116141658017f823c633c2f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:55:58.142284 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-6ddd7968-0482-4aba-9a45-aabf31079f73 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] 10.222.0.48 "GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a" status: 200 len: 1723 microversion: 2.1 time: 0.159107 Jul 21 10:55:58.142890 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 522/1032] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:55:57 2022] GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:55:58.291332 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-aded3a1d-61ac-4911-ac4f-fb757c9d9c82 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:55:58.292681 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-aded3a1d-61ac-4911-ac4f-fb757c9d9c82 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] [instance: 6ef47e35-a90e-4c42-9bbc-1e09a85d7d0e] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:55:58.301776 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-aded3a1d-61ac-4911-ac4f-fb757c9d9c82 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:55:58.303080 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-aded3a1d-61ac-4911-ac4f-fb757c9d9c82 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:55:58.304107 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-aded3a1d-61ac-4911-ac4f-fb757c9d9c82 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:55:58.304665 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-aded3a1d-61ac-4911-ac4f-fb757c9d9c82 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:55:58.369008 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-aded3a1d-61ac-4911-ac4f-fb757c9d9c82 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0aebc4614c448bdb77fb167d4ae3de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99e5deac07a429c9c771ef41d278a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:55:58.377497 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-aded3a1d-61ac-4911-ac4f-fb757c9d9c82 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] 10.222.0.48 "GET /compute/v2.1/servers/6ef47e35-a90e-4c42-9bbc-1e09a85d7d0e" status: 200 len: 1210 microversion: 2.1 time: 0.091198 Jul 21 10:55:58.379155 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 511/1033] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:55:58 2022] GET /compute/v2.1/servers/6ef47e35-a90e-4c42-9bbc-1e09a85d7d0e => generated 1210 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:55:59.160831 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-ec077d8a-7333-435c-9b75-71899652de2c tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:55:59.161525 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-ec077d8a-7333-435c-9b75-71899652de2c tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] [instance: 5ec19443-8399-4f5f-b530-179ac8488e8a] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:55:59.169992 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ec077d8a-7333-435c-9b75-71899652de2c tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:55:59.170143 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ec077d8a-7333-435c-9b75-71899652de2c tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:55:59.170929 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ec077d8a-7333-435c-9b75-71899652de2c tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:55:59.171445 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ec077d8a-7333-435c-9b75-71899652de2c tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:55:59.309416 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-ec077d8a-7333-435c-9b75-71899652de2c tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d76fa94b5ff4721bf490efd0699688e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3ae8ed116141658017f823c633c2f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:55:59.318477 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-ec077d8a-7333-435c-9b75-71899652de2c tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] 10.222.0.48 "GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a" status: 200 len: 1723 microversion: 2.1 time: 0.162138 Jul 21 10:55:59.319077 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 523/1034] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:55:59 2022] GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:55:59.395335 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-e6fe7375-8340-4caf-bae9-a6ece926f338 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:55:59.396712 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-e6fe7375-8340-4caf-bae9-a6ece926f338 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] [instance: 6ef47e35-a90e-4c42-9bbc-1e09a85d7d0e] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:55:59.405671 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e6fe7375-8340-4caf-bae9-a6ece926f338 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:55:59.407028 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e6fe7375-8340-4caf-bae9-a6ece926f338 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:55:59.407830 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e6fe7375-8340-4caf-bae9-a6ece926f338 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:55:59.408271 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e6fe7375-8340-4caf-bae9-a6ece926f338 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:55:59.566259 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-e6fe7375-8340-4caf-bae9-a6ece926f338 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0aebc4614c448bdb77fb167d4ae3de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99e5deac07a429c9c771ef41d278a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:55:59.579914 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-e6fe7375-8340-4caf-bae9-a6ece926f338 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] 10.222.0.48 "GET /compute/v2.1/servers/6ef47e35-a90e-4c42-9bbc-1e09a85d7d0e" status: 200 len: 1277 microversion: 2.1 time: 0.188816 Jul 21 10:55:59.585981 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 512/1035] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:55:59 2022] GET /compute/v2.1/servers/6ef47e35-a90e-4c42-9bbc-1e09a85d7d0e => generated 1277 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:55:59.728695 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [req-6bde8caf-9579-490b-80df-8a90c898abbe req-16fd4f2d-ea9f-4538-8b3a-2d5b0584a438 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ef47e35-a90e-4c42-9bbc-1e09a85d7d0e", "tag": "ddef567e-1162-4e85-93ce-7def8406c8b9"}]} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:55:59.742152 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-6bde8caf-9579-490b-80df-8a90c898abbe req-16fd4f2d-ea9f-4538-8b3a-2d5b0584a438 service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:55:59.742615 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-6bde8caf-9579-490b-80df-8a90c898abbe req-16fd4f2d-ea9f-4538-8b3a-2d5b0584a438 service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:55:59.755760 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.compute.server_external_events [req-6bde8caf-9579-490b-80df-8a90c898abbe req-16fd4f2d-ea9f-4538-8b3a-2d5b0584a438 service nova] Creating event network-changed:ddef567e-1162-4e85-93ce-7def8406c8b9 for instance 6ef47e35-a90e-4c42-9bbc-1e09a85d7d0e on hv-cinder-84980 Jul 21 10:55:59.762392 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [req-6bde8caf-9579-490b-80df-8a90c898abbe req-16fd4f2d-ea9f-4538-8b3a-2d5b0584a438 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036660 Jul 21 10:55:59.763835 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 524/1036] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 21 10:55:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:56:00.335715 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-8aefc577-3148-47a9-b5ac-61a8ff418659 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:56:00.336323 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-8aefc577-3148-47a9-b5ac-61a8ff418659 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] [instance: 5ec19443-8399-4f5f-b530-179ac8488e8a] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:56:00.342218 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8aefc577-3148-47a9-b5ac-61a8ff418659 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:56:00.342709 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8aefc577-3148-47a9-b5ac-61a8ff418659 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:56:00.343465 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8aefc577-3148-47a9-b5ac-61a8ff418659 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:56:00.344169 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8aefc577-3148-47a9-b5ac-61a8ff418659 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:56:00.474202 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-8aefc577-3148-47a9-b5ac-61a8ff418659 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d76fa94b5ff4721bf490efd0699688e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3ae8ed116141658017f823c633c2f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:56:00.482157 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-8aefc577-3148-47a9-b5ac-61a8ff418659 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] 10.222.0.48 "GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a" status: 200 len: 1700 microversion: 2.1 time: 0.150619 Jul 21 10:56:00.482758 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 513/1037] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:56:00 2022] GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a => generated 1700 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:56:00.500624 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-fcd3f99c-7ed7-4908-947a-2fd96482aeb9 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:56:00.510972 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fcd3f99c-7ed7-4908-947a-2fd96482aeb9 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:56:00.510972 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fcd3f99c-7ed7-4908-947a-2fd96482aeb9 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:56:00.567035 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-fcd3f99c-7ed7-4908-947a-2fd96482aeb9 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] [instance: 5ec19443-8399-4f5f-b530-179ac8488e8a] Going to try to start instance {{(pid=124867) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 21 10:56:00.597944 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-f2ef0fb9-037c-418e-a7b8-70ed32006ee7 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:56:00.598738 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-f2ef0fb9-037c-418e-a7b8-70ed32006ee7 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] [instance: 6ef47e35-a90e-4c42-9bbc-1e09a85d7d0e] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:56:00.604678 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f2ef0fb9-037c-418e-a7b8-70ed32006ee7 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:56:00.605127 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f2ef0fb9-037c-418e-a7b8-70ed32006ee7 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:56:00.605888 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f2ef0fb9-037c-418e-a7b8-70ed32006ee7 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:56:00.606322 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f2ef0fb9-037c-418e-a7b8-70ed32006ee7 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:56:00.611016 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:56:00.740972 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-f2ef0fb9-037c-418e-a7b8-70ed32006ee7 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0aebc4614c448bdb77fb167d4ae3de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99e5deac07a429c9c771ef41d278a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:56:00.748395 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-f2ef0fb9-037c-418e-a7b8-70ed32006ee7 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] 10.222.0.48 "GET /compute/v2.1/servers/6ef47e35-a90e-4c42-9bbc-1e09a85d7d0e" status: 200 len: 1265 microversion: 2.1 time: 0.154872 Jul 21 10:56:00.748963 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 514/1038] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:56:00 2022] GET /compute/v2.1/servers/6ef47e35-a90e-4c42-9bbc-1e09a85d7d0e => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:56:00.758067 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-fcd3f99c-7ed7-4908-947a-2fd96482aeb9 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] 10.222.0.48 "POST /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a/action" status: 202 len: 0 microversion: 2.1 time: 0.262600 Jul 21 10:56:00.758759 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 525/1039] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 21 10:56:00 2022] POST /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a/action => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 10:56:00.769413 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-3a6adb5d-b637-40ae-97d5-6bb6eabe658b tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:56:00.769413 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-3a6adb5d-b637-40ae-97d5-6bb6eabe658b tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] [instance: 5ec19443-8399-4f5f-b530-179ac8488e8a] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:56:00.769413 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_api:SELECT=35 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:56:00.774326 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3a6adb5d-b637-40ae-97d5-6bb6eabe658b tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:56:00.774826 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3a6adb5d-b637-40ae-97d5-6bb6eabe658b tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:56:00.775863 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3a6adb5d-b637-40ae-97d5-6bb6eabe658b tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:56:00.776302 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-3a6adb5d-b637-40ae-97d5-6bb6eabe658b tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:56:00.911179 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-3a6adb5d-b637-40ae-97d5-6bb6eabe658b tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d76fa94b5ff4721bf490efd0699688e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3ae8ed116141658017f823c633c2f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:56:00.919260 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-3a6adb5d-b637-40ae-97d5-6bb6eabe658b tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] 10.222.0.48 "GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a" status: 200 len: 1709 microversion: 2.1 time: 0.156458 Jul 21 10:56:00.919834 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 515/1040] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:56:00 2022] GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a => generated 1709 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:56:01.766956 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-8d6a6d87-4c43-49ab-8299-9763f041522f tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:56:01.767671 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-8d6a6d87-4c43-49ab-8299-9763f041522f tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] [instance: 6ef47e35-a90e-4c42-9bbc-1e09a85d7d0e] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:56:01.773841 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8d6a6d87-4c43-49ab-8299-9763f041522f tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:56:01.774288 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8d6a6d87-4c43-49ab-8299-9763f041522f tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:56:01.775080 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8d6a6d87-4c43-49ab-8299-9763f041522f tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:56:01.775519 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8d6a6d87-4c43-49ab-8299-9763f041522f tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:56:01.936481 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-885197ec-97cd-45cd-bbec-411e8495eae8 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:56:01.937107 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-885197ec-97cd-45cd-bbec-411e8495eae8 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] [instance: 5ec19443-8399-4f5f-b530-179ac8488e8a] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:56:01.950239 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-885197ec-97cd-45cd-bbec-411e8495eae8 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:56:01.950808 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-885197ec-97cd-45cd-bbec-411e8495eae8 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:56:01.951606 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-885197ec-97cd-45cd-bbec-411e8495eae8 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:56:01.952038 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-885197ec-97cd-45cd-bbec-411e8495eae8 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:56:02.132706 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-8d6a6d87-4c43-49ab-8299-9763f041522f tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0aebc4614c448bdb77fb167d4ae3de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99e5deac07a429c9c771ef41d278a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:56:02.135993 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-885197ec-97cd-45cd-bbec-411e8495eae8 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d76fa94b5ff4721bf490efd0699688e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3ae8ed116141658017f823c633c2f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:56:02.140262 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-8d6a6d87-4c43-49ab-8299-9763f041522f tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] 10.222.0.48 "GET /compute/v2.1/servers/6ef47e35-a90e-4c42-9bbc-1e09a85d7d0e" status: 200 len: 1265 microversion: 2.1 time: 0.378283 Jul 21 10:56:02.140976 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 526/1041] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:56:01 2022] GET /compute/v2.1/servers/6ef47e35-a90e-4c42-9bbc-1e09a85d7d0e => generated 1265 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:56:02.143931 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-885197ec-97cd-45cd-bbec-411e8495eae8 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] 10.222.0.48 "GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a" status: 200 len: 1709 microversion: 2.1 time: 0.211283 Jul 21 10:56:02.144779 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 516/1042] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:56:01 2022] GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a => generated 1709 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:56:03.157957 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-254f452f-8681-4619-92ea-90cef5241e16 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:56:03.158593 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-254f452f-8681-4619-92ea-90cef5241e16 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] [instance: 6ef47e35-a90e-4c42-9bbc-1e09a85d7d0e] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:56:03.161401 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-bbc462e6-5880-44a5-8556-42842da869c0 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:56:03.162015 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-bbc462e6-5880-44a5-8556-42842da869c0 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] [instance: 5ec19443-8399-4f5f-b530-179ac8488e8a] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:56:03.165474 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-254f452f-8681-4619-92ea-90cef5241e16 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:56:03.165739 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-254f452f-8681-4619-92ea-90cef5241e16 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:56:03.166435 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-254f452f-8681-4619-92ea-90cef5241e16 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:56:03.167068 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-254f452f-8681-4619-92ea-90cef5241e16 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:56:03.168592 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-bbc462e6-5880-44a5-8556-42842da869c0 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:56:03.169044 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-bbc462e6-5880-44a5-8556-42842da869c0 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:56:03.169809 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-bbc462e6-5880-44a5-8556-42842da869c0 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:56:03.170246 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-bbc462e6-5880-44a5-8556-42842da869c0 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:56:03.360902 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-254f452f-8681-4619-92ea-90cef5241e16 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0aebc4614c448bdb77fb167d4ae3de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99e5deac07a429c9c771ef41d278a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:56:03.367645 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-bbc462e6-5880-44a5-8556-42842da869c0 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d76fa94b5ff4721bf490efd0699688e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3ae8ed116141658017f823c633c2f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:56:03.368553 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-254f452f-8681-4619-92ea-90cef5241e16 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] 10.222.0.48 "GET /compute/v2.1/servers/6ef47e35-a90e-4c42-9bbc-1e09a85d7d0e" status: 200 len: 1265 microversion: 2.1 time: 0.215191 Jul 21 10:56:03.369123 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 527/1043] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:56:03 2022] GET /compute/v2.1/servers/6ef47e35-a90e-4c42-9bbc-1e09a85d7d0e => generated 1265 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:56:03.375956 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-bbc462e6-5880-44a5-8556-42842da869c0 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] 10.222.0.48 "GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a" status: 200 len: 1713 microversion: 2.1 time: 0.218304 Jul 21 10:56:03.376515 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 517/1044] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:56:03 2022] GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a => generated 1713 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:56:04.385052 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-79f5b6f3-abb7-445e-a206-42199c462a7f tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:56:04.385654 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-79f5b6f3-abb7-445e-a206-42199c462a7f tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] [instance: 6ef47e35-a90e-4c42-9bbc-1e09a85d7d0e] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:56:04.392610 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-79f5b6f3-abb7-445e-a206-42199c462a7f tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:56:04.393048 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-79f5b6f3-abb7-445e-a206-42199c462a7f tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:56:04.393797 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-79f5b6f3-abb7-445e-a206-42199c462a7f tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:56:04.394225 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-79f5b6f3-abb7-445e-a206-42199c462a7f tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:56:04.524865 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-79f5b6f3-abb7-445e-a206-42199c462a7f tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0aebc4614c448bdb77fb167d4ae3de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99e5deac07a429c9c771ef41d278a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:56:04.533038 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-79f5b6f3-abb7-445e-a206-42199c462a7f tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] 10.222.0.48 "GET /compute/v2.1/servers/6ef47e35-a90e-4c42-9bbc-1e09a85d7d0e" status: 200 len: 1265 microversion: 2.1 time: 0.151750 Jul 21 10:56:04.533609 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 528/1045] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:56:04 2022] GET /compute/v2.1/servers/6ef47e35-a90e-4c42-9bbc-1e09a85d7d0e => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:56:05.550434 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-35eaa930-3d49-466e-a41d-9ff601979a9f tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:56:05.551085 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-35eaa930-3d49-466e-a41d-9ff601979a9f tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] [instance: 6ef47e35-a90e-4c42-9bbc-1e09a85d7d0e] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:56:05.557591 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-35eaa930-3d49-466e-a41d-9ff601979a9f tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:56:05.558042 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-35eaa930-3d49-466e-a41d-9ff601979a9f tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:56:05.558827 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-35eaa930-3d49-466e-a41d-9ff601979a9f tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:56:05.559265 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-35eaa930-3d49-466e-a41d-9ff601979a9f tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:56:05.703836 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-35eaa930-3d49-466e-a41d-9ff601979a9f tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0aebc4614c448bdb77fb167d4ae3de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99e5deac07a429c9c771ef41d278a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:56:05.703836 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-35eaa930-3d49-466e-a41d-9ff601979a9f tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] 10.222.0.48 "GET /compute/v2.1/servers/6ef47e35-a90e-4c42-9bbc-1e09a85d7d0e" status: 200 len: 1265 microversion: 2.1 time: 0.157244 Jul 21 10:56:05.703836 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 518/1046] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:56:05 2022] GET /compute/v2.1/servers/6ef47e35-a90e-4c42-9bbc-1e09a85d7d0e => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:56:06.720330 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-ad180a5c-b558-4e5c-b151-7edf906fc94b tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:56:06.721657 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-ad180a5c-b558-4e5c-b151-7edf906fc94b tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] [instance: 6ef47e35-a90e-4c42-9bbc-1e09a85d7d0e] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:56:06.723364 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell0:SELECT=2 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:56:06.724040 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell0:SELECT=6 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:56:06.729204 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ad180a5c-b558-4e5c-b151-7edf906fc94b tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:56:06.729649 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ad180a5c-b558-4e5c-b151-7edf906fc94b tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:56:06.730411 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ad180a5c-b558-4e5c-b151-7edf906fc94b tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:56:06.730875 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ad180a5c-b558-4e5c-b151-7edf906fc94b tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:56:06.735120 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:56:06.862714 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-ad180a5c-b558-4e5c-b151-7edf906fc94b tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0aebc4614c448bdb77fb167d4ae3de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99e5deac07a429c9c771ef41d278a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:56:06.870607 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-ad180a5c-b558-4e5c-b151-7edf906fc94b tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] 10.222.0.48 "GET /compute/v2.1/servers/6ef47e35-a90e-4c42-9bbc-1e09a85d7d0e" status: 200 len: 1265 microversion: 2.1 time: 0.154187 Jul 21 10:56:06.881989 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 529/1047] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:56:06 2022] GET /compute/v2.1/servers/6ef47e35-a90e-4c42-9bbc-1e09a85d7d0e => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:56:07.888058 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-a8f53820-8c07-4a63-8f28-37a3a496908c tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:56:07.888744 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-a8f53820-8c07-4a63-8f28-37a3a496908c tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] [instance: 6ef47e35-a90e-4c42-9bbc-1e09a85d7d0e] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:56:07.893119 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell0:SELECT=2 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:56:07.897412 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a8f53820-8c07-4a63-8f28-37a3a496908c tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:56:07.897872 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a8f53820-8c07-4a63-8f28-37a3a496908c tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:56:07.898674 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a8f53820-8c07-4a63-8f28-37a3a496908c tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:56:07.899160 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a8f53820-8c07-4a63-8f28-37a3a496908c tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:56:08.034052 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-a8f53820-8c07-4a63-8f28-37a3a496908c tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0aebc4614c448bdb77fb167d4ae3de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99e5deac07a429c9c771ef41d278a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:56:08.041558 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-a8f53820-8c07-4a63-8f28-37a3a496908c tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] 10.222.0.48 "GET /compute/v2.1/servers/6ef47e35-a90e-4c42-9bbc-1e09a85d7d0e" status: 200 len: 1265 microversion: 2.1 time: 0.157439 Jul 21 10:56:08.042121 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 519/1048] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:56:07 2022] GET /compute/v2.1/servers/6ef47e35-a90e-4c42-9bbc-1e09a85d7d0e => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:56:09.057881 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-4e72dd48-fb87-49e8-97cb-debccf3b8b72 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:56:09.058473 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-4e72dd48-fb87-49e8-97cb-debccf3b8b72 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] [instance: 6ef47e35-a90e-4c42-9bbc-1e09a85d7d0e] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:56:09.060327 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=4 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:56:09.065253 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-4e72dd48-fb87-49e8-97cb-debccf3b8b72 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:56:09.071089 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-4e72dd48-fb87-49e8-97cb-debccf3b8b72 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:56:09.071089 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-4e72dd48-fb87-49e8-97cb-debccf3b8b72 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:56:09.071089 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-4e72dd48-fb87-49e8-97cb-debccf3b8b72 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:56:09.197528 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-4e72dd48-fb87-49e8-97cb-debccf3b8b72 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0aebc4614c448bdb77fb167d4ae3de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99e5deac07a429c9c771ef41d278a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:56:09.205609 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-4e72dd48-fb87-49e8-97cb-debccf3b8b72 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] 10.222.0.48 "GET /compute/v2.1/servers/6ef47e35-a90e-4c42-9bbc-1e09a85d7d0e" status: 200 len: 1265 microversion: 2.1 time: 0.152081 Jul 21 10:56:09.206156 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 530/1049] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:56:09 2022] GET /compute/v2.1/servers/6ef47e35-a90e-4c42-9bbc-1e09a85d7d0e => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:56:09.476473 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [req-d92fbb96-63be-4b15-8004-c766054f472e req-4f59f3b0-be8f-4459-af74-d23dc67b69f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ef47e35-a90e-4c42-9bbc-1e09a85d7d0e", "name": "network-vif-plugged", "status": "completed", "tag": "ddef567e-1162-4e85-93ce-7def8406c8b9"}]} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:56:09.485365 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-d92fbb96-63be-4b15-8004-c766054f472e req-4f59f3b0-be8f-4459-af74-d23dc67b69f4 service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:56:09.485805 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-d92fbb96-63be-4b15-8004-c766054f472e req-4f59f3b0-be8f-4459-af74-d23dc67b69f4 service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:56:09.496381 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.compute.server_external_events [req-d92fbb96-63be-4b15-8004-c766054f472e req-4f59f3b0-be8f-4459-af74-d23dc67b69f4 service nova] Creating event network-vif-plugged:ddef567e-1162-4e85-93ce-7def8406c8b9 for instance 6ef47e35-a90e-4c42-9bbc-1e09a85d7d0e on hv-cinder-84980 Jul 21 10:56:09.502270 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [req-d92fbb96-63be-4b15-8004-c766054f472e req-4f59f3b0-be8f-4459-af74-d23dc67b69f4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029322 Jul 21 10:56:09.511738 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 520/1050] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 21 10:56:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:56:10.223736 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-702b6da9-2c97-4b9f-880e-efe591748a2a tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:56:10.224349 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-702b6da9-2c97-4b9f-880e-efe591748a2a tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] [instance: 6ef47e35-a90e-4c42-9bbc-1e09a85d7d0e] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:56:10.230855 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-702b6da9-2c97-4b9f-880e-efe591748a2a tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:56:10.231304 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-702b6da9-2c97-4b9f-880e-efe591748a2a tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:56:10.232061 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-702b6da9-2c97-4b9f-880e-efe591748a2a tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:56:10.232497 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-702b6da9-2c97-4b9f-880e-efe591748a2a tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:56:10.364679 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-702b6da9-2c97-4b9f-880e-efe591748a2a tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0aebc4614c448bdb77fb167d4ae3de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99e5deac07a429c9c771ef41d278a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:56:10.372107 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-702b6da9-2c97-4b9f-880e-efe591748a2a tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] 10.222.0.48 "GET /compute/v2.1/servers/6ef47e35-a90e-4c42-9bbc-1e09a85d7d0e" status: 200 len: 1265 microversion: 2.1 time: 0.152227 Jul 21 10:56:10.372664 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 531/1051] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:56:10 2022] GET /compute/v2.1/servers/6ef47e35-a90e-4c42-9bbc-1e09a85d7d0e => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:56:11.388801 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-1392411b-942e-4c62-a935-f998c560751f tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:56:11.389485 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-1392411b-942e-4c62-a935-f998c560751f tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] [instance: 6ef47e35-a90e-4c42-9bbc-1e09a85d7d0e] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:56:11.396827 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1392411b-942e-4c62-a935-f998c560751f tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:56:11.397279 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1392411b-942e-4c62-a935-f998c560751f tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:56:11.398036 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1392411b-942e-4c62-a935-f998c560751f tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:56:11.398466 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1392411b-942e-4c62-a935-f998c560751f tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:56:11.531751 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-1392411b-942e-4c62-a935-f998c560751f tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0aebc4614c448bdb77fb167d4ae3de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99e5deac07a429c9c771ef41d278a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:56:11.539171 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-1392411b-942e-4c62-a935-f998c560751f tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] 10.222.0.48 "GET /compute/v2.1/servers/6ef47e35-a90e-4c42-9bbc-1e09a85d7d0e" status: 200 len: 1452 microversion: 2.1 time: 0.155042 Jul 21 10:56:11.539750 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 521/1052] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:56:11 2022] GET /compute/v2.1/servers/6ef47e35-a90e-4c42-9bbc-1e09a85d7d0e => generated 1452 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:56:11.555409 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-85d8d003-321e-49bd-90ca-631008fb8e19 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:56:11.556041 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-85d8d003-321e-49bd-90ca-631008fb8e19 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] [instance: 6ef47e35-a90e-4c42-9bbc-1e09a85d7d0e] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:56:11.563319 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-85d8d003-321e-49bd-90ca-631008fb8e19 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:56:11.563772 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-85d8d003-321e-49bd-90ca-631008fb8e19 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:56:11.564530 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-85d8d003-321e-49bd-90ca-631008fb8e19 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:56:11.564967 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-85d8d003-321e-49bd-90ca-631008fb8e19 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:56:11.693880 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-85d8d003-321e-49bd-90ca-631008fb8e19 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0aebc4614c448bdb77fb167d4ae3de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99e5deac07a429c9c771ef41d278a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:56:11.701238 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-85d8d003-321e-49bd-90ca-631008fb8e19 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] 10.222.0.48 "GET /compute/v2.1/servers/6ef47e35-a90e-4c42-9bbc-1e09a85d7d0e" status: 200 len: 1452 microversion: 2.1 time: 0.149605 Jul 21 10:56:11.701786 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 532/1053] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:56:11 2022] GET /compute/v2.1/servers/6ef47e35-a90e-4c42-9bbc-1e09a85d7d0e => generated 1452 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:56:13.923018 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [req-4ada062d-8eef-4482-822f-07520a8c13d4 req-06154467-a2bb-4521-96ce-1ce09ced27d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ef47e35-a90e-4c42-9bbc-1e09a85d7d0e", "tag": "ddef567e-1162-4e85-93ce-7def8406c8b9"}]} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:56:13.931453 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-4ada062d-8eef-4482-822f-07520a8c13d4 req-06154467-a2bb-4521-96ce-1ce09ced27d2 service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:56:13.931888 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-4ada062d-8eef-4482-822f-07520a8c13d4 req-06154467-a2bb-4521-96ce-1ce09ced27d2 service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:56:13.943429 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.compute.server_external_events [req-4ada062d-8eef-4482-822f-07520a8c13d4 req-06154467-a2bb-4521-96ce-1ce09ced27d2 service nova] Creating event network-changed:ddef567e-1162-4e85-93ce-7def8406c8b9 for instance 6ef47e35-a90e-4c42-9bbc-1e09a85d7d0e on hv-cinder-84980 Jul 21 10:56:13.948163 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [req-4ada062d-8eef-4482-822f-07520a8c13d4 req-06154467-a2bb-4521-96ce-1ce09ced27d2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029624 Jul 21 10:56:13.948978 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 522/1054] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 21 10:56:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:56:36.439370 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-a766ac6a-9219-4bfd-b4b1-a9584c7c3c73 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:56:36.439904 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-a766ac6a-9219-4bfd-b4b1-a9584c7c3c73 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] [instance: 5ec19443-8399-4f5f-b530-179ac8488e8a] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:56:36.442932 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_api:SELECT=5 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:56:36.443669 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell1:SELECT=22 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:56:36.448256 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a766ac6a-9219-4bfd-b4b1-a9584c7c3c73 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:56:36.448695 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a766ac6a-9219-4bfd-b4b1-a9584c7c3c73 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:56:36.449451 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a766ac6a-9219-4bfd-b4b1-a9584c7c3c73 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:56:36.449881 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a766ac6a-9219-4bfd-b4b1-a9584c7c3c73 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:56:36.627003 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.objects.instance [None req-a766ac6a-9219-4bfd-b4b1-a9584c7c3c73 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lazy-loading 'services' on Instance uuid 5ec19443-8399-4f5f-b530-179ac8488e8a {{(pid=124867) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 10:56:36.850872 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-a766ac6a-9219-4bfd-b4b1-a9584c7c3c73 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] 10.222.0.48 "DELETE /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a/os-volume_attachments/7332af35-fc27-4b3c-8c29-919ca2b2b5cc" status: 202 len: 0 microversion: 2.1 time: 0.415409 Jul 21 10:56:36.851469 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 533/1055] 10.222.0.48 () {58 vars in 1415 bytes} [Thu Jul 21 10:56:36 2022] DELETE /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a/os-volume_attachments/7332af35-fc27-4b3c-8c29-919ca2b2b5cc => generated 0 bytes in 417 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 10:56:37.963058 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_api:SELECT=15 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:56:37.963930 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell1:SELECT=45 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:56:37.967916 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-cc225ecd-d8aa-4579-9610-c5055a50bd9c tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:56:37.974265 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-cc225ecd-d8aa-4579-9610-c5055a50bd9c tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:56:37.974759 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-cc225ecd-d8aa-4579-9610-c5055a50bd9c tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:56:37.999353 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-cc225ecd-d8aa-4579-9610-c5055a50bd9c tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] [instance: 5ec19443-8399-4f5f-b530-179ac8488e8a] Going to try to stop instance {{(pid=124868) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 21 10:56:38.162181 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-cc225ecd-d8aa-4579-9610-c5055a50bd9c tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] 10.222.0.48 "POST /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a/action" status: 202 len: 0 microversion: 2.1 time: 0.200394 Jul 21 10:56:38.162865 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 523/1056] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 21 10:56:37 2022] POST /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a/action => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 21 10:56:38.172573 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-6e134d85-b2ed-4d43-86dc-7aa963849bee tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:56:38.173270 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-6e134d85-b2ed-4d43-86dc-7aa963849bee tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] [instance: 5ec19443-8399-4f5f-b530-179ac8488e8a] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:56:38.180634 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6e134d85-b2ed-4d43-86dc-7aa963849bee tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:56:38.181081 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6e134d85-b2ed-4d43-86dc-7aa963849bee tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:56:38.181844 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6e134d85-b2ed-4d43-86dc-7aa963849bee tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:56:38.182278 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6e134d85-b2ed-4d43-86dc-7aa963849bee tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:56:38.318285 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-6e134d85-b2ed-4d43-86dc-7aa963849bee tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d76fa94b5ff4721bf490efd0699688e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3ae8ed116141658017f823c633c2f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:56:38.325778 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-6e134d85-b2ed-4d43-86dc-7aa963849bee tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] 10.222.0.48 "GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a" status: 200 len: 1677 microversion: 2.1 time: 0.158070 Jul 21 10:56:38.326343 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 534/1057] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:56:38 2022] GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:56:39.344054 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-8ac6cf7f-7f67-4395-b10d-4f3d9d2bd4f7 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:56:39.344743 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-8ac6cf7f-7f67-4395-b10d-4f3d9d2bd4f7 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] [instance: 5ec19443-8399-4f5f-b530-179ac8488e8a] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:56:39.352058 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8ac6cf7f-7f67-4395-b10d-4f3d9d2bd4f7 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:56:39.352501 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8ac6cf7f-7f67-4395-b10d-4f3d9d2bd4f7 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:56:39.353278 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8ac6cf7f-7f67-4395-b10d-4f3d9d2bd4f7 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:56:39.353707 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8ac6cf7f-7f67-4395-b10d-4f3d9d2bd4f7 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:56:39.534445 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-8ac6cf7f-7f67-4395-b10d-4f3d9d2bd4f7 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d76fa94b5ff4721bf490efd0699688e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3ae8ed116141658017f823c633c2f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:56:39.542682 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-8ac6cf7f-7f67-4395-b10d-4f3d9d2bd4f7 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] 10.222.0.48 "GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a" status: 200 len: 1677 microversion: 2.1 time: 0.202790 Jul 21 10:56:39.543240 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 524/1058] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:56:39 2022] GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a => generated 1677 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:56:40.560306 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-6a91195d-2d41-4a17-8be5-ee7402a4603a tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:56:40.560919 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-6a91195d-2d41-4a17-8be5-ee7402a4603a tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] [instance: 5ec19443-8399-4f5f-b530-179ac8488e8a] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:56:40.567169 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6a91195d-2d41-4a17-8be5-ee7402a4603a tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:56:40.567619 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6a91195d-2d41-4a17-8be5-ee7402a4603a tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:56:40.568381 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6a91195d-2d41-4a17-8be5-ee7402a4603a tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:56:40.568816 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6a91195d-2d41-4a17-8be5-ee7402a4603a tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:56:40.695871 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-6a91195d-2d41-4a17-8be5-ee7402a4603a tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d76fa94b5ff4721bf490efd0699688e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3ae8ed116141658017f823c633c2f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:56:40.703236 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-6a91195d-2d41-4a17-8be5-ee7402a4603a tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] 10.222.0.48 "GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a" status: 200 len: 1677 microversion: 2.1 time: 0.146832 Jul 21 10:56:40.703795 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 535/1059] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:56:40 2022] GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a => generated 1677 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:56:41.721477 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-5d193be2-3738-47b9-bf20-57e077e042bc tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:56:41.722092 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-5d193be2-3738-47b9-bf20-57e077e042bc tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] [instance: 5ec19443-8399-4f5f-b530-179ac8488e8a] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:56:41.728862 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5d193be2-3738-47b9-bf20-57e077e042bc tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:56:41.729321 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5d193be2-3738-47b9-bf20-57e077e042bc tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:56:41.730087 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5d193be2-3738-47b9-bf20-57e077e042bc tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:56:41.730527 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-5d193be2-3738-47b9-bf20-57e077e042bc tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:56:41.861435 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-5d193be2-3738-47b9-bf20-57e077e042bc tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d76fa94b5ff4721bf490efd0699688e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3ae8ed116141658017f823c633c2f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:56:41.868939 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-5d193be2-3738-47b9-bf20-57e077e042bc tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] 10.222.0.48 "GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a" status: 200 len: 1677 microversion: 2.1 time: 0.151341 Jul 21 10:56:41.869511 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 525/1060] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:56:41 2022] GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:56:42.885767 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-6920716b-7e2c-4abf-93fe-b2ad9c20a410 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:56:42.886365 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-6920716b-7e2c-4abf-93fe-b2ad9c20a410 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] [instance: 5ec19443-8399-4f5f-b530-179ac8488e8a] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:56:42.892794 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6920716b-7e2c-4abf-93fe-b2ad9c20a410 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:56:42.893241 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6920716b-7e2c-4abf-93fe-b2ad9c20a410 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:56:42.894020 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6920716b-7e2c-4abf-93fe-b2ad9c20a410 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:56:42.894526 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6920716b-7e2c-4abf-93fe-b2ad9c20a410 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:56:43.023175 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-6920716b-7e2c-4abf-93fe-b2ad9c20a410 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d76fa94b5ff4721bf490efd0699688e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3ae8ed116141658017f823c633c2f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:56:43.030564 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-6920716b-7e2c-4abf-93fe-b2ad9c20a410 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] 10.222.0.48 "GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a" status: 200 len: 1677 microversion: 2.1 time: 0.148673 Jul 21 10:56:43.032651 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 536/1061] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:56:42 2022] GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:56:44.048524 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-54a3ccb9-8118-4e1c-803e-9e30c800aa38 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:56:44.049133 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-54a3ccb9-8118-4e1c-803e-9e30c800aa38 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] [instance: 5ec19443-8399-4f5f-b530-179ac8488e8a] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:56:44.056204 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-54a3ccb9-8118-4e1c-803e-9e30c800aa38 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:56:44.056655 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-54a3ccb9-8118-4e1c-803e-9e30c800aa38 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:56:44.057414 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-54a3ccb9-8118-4e1c-803e-9e30c800aa38 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:56:44.057848 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-54a3ccb9-8118-4e1c-803e-9e30c800aa38 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:56:44.184534 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-54a3ccb9-8118-4e1c-803e-9e30c800aa38 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d76fa94b5ff4721bf490efd0699688e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3ae8ed116141658017f823c633c2f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:56:44.192915 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-54a3ccb9-8118-4e1c-803e-9e30c800aa38 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] 10.222.0.48 "GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a" status: 200 len: 1677 microversion: 2.1 time: 0.148243 Jul 21 10:56:44.193498 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 526/1062] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:56:44 2022] GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a => generated 1677 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:56:45.210087 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-04e6ea29-4f1d-4e7d-a693-35e4ab4f6b13 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:56:45.210726 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-04e6ea29-4f1d-4e7d-a693-35e4ab4f6b13 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] [instance: 5ec19443-8399-4f5f-b530-179ac8488e8a] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:56:45.217207 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-04e6ea29-4f1d-4e7d-a693-35e4ab4f6b13 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:56:45.217658 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-04e6ea29-4f1d-4e7d-a693-35e4ab4f6b13 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:56:45.218416 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-04e6ea29-4f1d-4e7d-a693-35e4ab4f6b13 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:56:45.218877 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-04e6ea29-4f1d-4e7d-a693-35e4ab4f6b13 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:56:45.351778 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-04e6ea29-4f1d-4e7d-a693-35e4ab4f6b13 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d76fa94b5ff4721bf490efd0699688e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3ae8ed116141658017f823c633c2f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:56:45.359218 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-04e6ea29-4f1d-4e7d-a693-35e4ab4f6b13 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] 10.222.0.48 "GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a" status: 200 len: 1677 microversion: 2.1 time: 0.153331 Jul 21 10:56:45.359776 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 537/1063] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:56:45 2022] GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:56:46.376491 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-13d9f913-5369-4122-a61e-87ada2e82dd2 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:56:46.377102 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-13d9f913-5369-4122-a61e-87ada2e82dd2 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] [instance: 5ec19443-8399-4f5f-b530-179ac8488e8a] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:56:46.384249 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-13d9f913-5369-4122-a61e-87ada2e82dd2 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:56:46.384693 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-13d9f913-5369-4122-a61e-87ada2e82dd2 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:56:46.385453 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-13d9f913-5369-4122-a61e-87ada2e82dd2 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:56:46.385884 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-13d9f913-5369-4122-a61e-87ada2e82dd2 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:56:46.513008 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-13d9f913-5369-4122-a61e-87ada2e82dd2 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d76fa94b5ff4721bf490efd0699688e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3ae8ed116141658017f823c633c2f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:56:46.520451 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-13d9f913-5369-4122-a61e-87ada2e82dd2 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] 10.222.0.48 "GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a" status: 200 len: 1677 microversion: 2.1 time: 0.147811 Jul 21 10:56:46.521003 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 527/1064] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:56:46 2022] GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a => generated 1677 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:56:47.538421 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-9a55133b-5810-43d8-81c1-caab27106088 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:56:47.539017 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-9a55133b-5810-43d8-81c1-caab27106088 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] [instance: 5ec19443-8399-4f5f-b530-179ac8488e8a] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:56:47.545509 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9a55133b-5810-43d8-81c1-caab27106088 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:56:47.545955 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9a55133b-5810-43d8-81c1-caab27106088 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:56:47.546750 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9a55133b-5810-43d8-81c1-caab27106088 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:56:47.547186 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-9a55133b-5810-43d8-81c1-caab27106088 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:56:47.680630 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-9a55133b-5810-43d8-81c1-caab27106088 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d76fa94b5ff4721bf490efd0699688e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3ae8ed116141658017f823c633c2f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:56:47.688079 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-9a55133b-5810-43d8-81c1-caab27106088 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] 10.222.0.48 "GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a" status: 200 len: 1677 microversion: 2.1 time: 0.154241 Jul 21 10:56:47.688636 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 538/1065] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:56:47 2022] GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:56:48.704638 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-df4870a4-8c2c-462b-8ba7-943862611d7c tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:56:48.705251 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-df4870a4-8c2c-462b-8ba7-943862611d7c tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] [instance: 5ec19443-8399-4f5f-b530-179ac8488e8a] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:56:48.711845 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-df4870a4-8c2c-462b-8ba7-943862611d7c tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:56:48.712295 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-df4870a4-8c2c-462b-8ba7-943862611d7c tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:56:48.713069 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-df4870a4-8c2c-462b-8ba7-943862611d7c tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:56:48.713543 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-df4870a4-8c2c-462b-8ba7-943862611d7c tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:56:48.855065 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-df4870a4-8c2c-462b-8ba7-943862611d7c tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d76fa94b5ff4721bf490efd0699688e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3ae8ed116141658017f823c633c2f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:56:48.866605 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-df4870a4-8c2c-462b-8ba7-943862611d7c tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] 10.222.0.48 "GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a" status: 200 len: 1677 microversion: 2.1 time: 0.165177 Jul 21 10:56:48.867202 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 528/1066] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:56:48 2022] GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a => generated 1677 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:56:49.885510 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-6ee1dd6e-534e-4665-82c7-4fbf9431ba65 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:56:49.886083 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-6ee1dd6e-534e-4665-82c7-4fbf9431ba65 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] [instance: 5ec19443-8399-4f5f-b530-179ac8488e8a] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:56:49.892502 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6ee1dd6e-534e-4665-82c7-4fbf9431ba65 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:56:49.895205 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6ee1dd6e-534e-4665-82c7-4fbf9431ba65 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:56:49.895205 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6ee1dd6e-534e-4665-82c7-4fbf9431ba65 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:56:49.895205 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6ee1dd6e-534e-4665-82c7-4fbf9431ba65 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:56:50.024584 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-6ee1dd6e-534e-4665-82c7-4fbf9431ba65 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d76fa94b5ff4721bf490efd0699688e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3ae8ed116141658017f823c633c2f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:56:50.032074 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-6ee1dd6e-534e-4665-82c7-4fbf9431ba65 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] 10.222.0.48 "GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a" status: 200 len: 1654 microversion: 2.1 time: 0.150584 Jul 21 10:56:50.037830 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 539/1067] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:56:49 2022] GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a => generated 1654 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:56:50.048475 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-d63eb440-ba1a-4349-8164-a29804e83577 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:56:50.055572 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d63eb440-ba1a-4349-8164-a29804e83577 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:56:50.056020 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d63eb440-ba1a-4349-8164-a29804e83577 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:56:50.080272 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-d63eb440-ba1a-4349-8164-a29804e83577 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] [instance: 5ec19443-8399-4f5f-b530-179ac8488e8a] Going to try to start instance {{(pid=124868) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 21 10:56:50.208787 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-d63eb440-ba1a-4349-8164-a29804e83577 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] 10.222.0.48 "POST /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a/action" status: 202 len: 0 microversion: 2.1 time: 0.163655 Jul 21 10:56:50.209386 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 529/1068] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 21 10:56:50 2022] POST /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a/action => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 10:56:50.218003 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-8f9942f1-0e1d-46cd-aa99-7c7fa7f4b089 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:56:50.218771 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-8f9942f1-0e1d-46cd-aa99-7c7fa7f4b089 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] [instance: 5ec19443-8399-4f5f-b530-179ac8488e8a] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:56:50.224894 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8f9942f1-0e1d-46cd-aa99-7c7fa7f4b089 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:56:50.225349 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8f9942f1-0e1d-46cd-aa99-7c7fa7f4b089 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:56:50.227952 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8f9942f1-0e1d-46cd-aa99-7c7fa7f4b089 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:56:50.227952 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8f9942f1-0e1d-46cd-aa99-7c7fa7f4b089 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:56:50.361965 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-8f9942f1-0e1d-46cd-aa99-7c7fa7f4b089 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d76fa94b5ff4721bf490efd0699688e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3ae8ed116141658017f823c633c2f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:56:50.370339 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-8f9942f1-0e1d-46cd-aa99-7c7fa7f4b089 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] 10.222.0.48 "GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a" status: 200 len: 1663 microversion: 2.1 time: 0.156327 Jul 21 10:56:50.370935 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 540/1069] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:56:50 2022] GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a => generated 1663 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:56:51.388444 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-8b057388-8732-4ee9-b14a-bb9e27fbd8e9 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:56:51.389135 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-8b057388-8732-4ee9-b14a-bb9e27fbd8e9 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] [instance: 5ec19443-8399-4f5f-b530-179ac8488e8a] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:56:51.396292 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8b057388-8732-4ee9-b14a-bb9e27fbd8e9 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:56:51.396732 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8b057388-8732-4ee9-b14a-bb9e27fbd8e9 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:56:51.397487 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8b057388-8732-4ee9-b14a-bb9e27fbd8e9 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:56:51.397948 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-8b057388-8732-4ee9-b14a-bb9e27fbd8e9 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:56:51.527114 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-8b057388-8732-4ee9-b14a-bb9e27fbd8e9 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d76fa94b5ff4721bf490efd0699688e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3ae8ed116141658017f823c633c2f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:56:51.534715 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-8b057388-8732-4ee9-b14a-bb9e27fbd8e9 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] 10.222.0.48 "GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a" status: 200 len: 1663 microversion: 2.1 time: 0.150851 Jul 21 10:56:51.535286 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 530/1070] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:56:51 2022] GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a => generated 1663 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:56:52.552007 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-fc59e321-215a-444f-87fc-4f3b7f29cf04 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:56:52.552526 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-fc59e321-215a-444f-87fc-4f3b7f29cf04 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] [instance: 5ec19443-8399-4f5f-b530-179ac8488e8a] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:56:52.559049 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fc59e321-215a-444f-87fc-4f3b7f29cf04 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:56:52.559499 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fc59e321-215a-444f-87fc-4f3b7f29cf04 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:56:52.560264 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fc59e321-215a-444f-87fc-4f3b7f29cf04 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:56:52.560697 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-fc59e321-215a-444f-87fc-4f3b7f29cf04 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:56:52.691420 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-fc59e321-215a-444f-87fc-4f3b7f29cf04 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d76fa94b5ff4721bf490efd0699688e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3ae8ed116141658017f823c633c2f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:56:52.698842 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-fc59e321-215a-444f-87fc-4f3b7f29cf04 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] 10.222.0.48 "GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a" status: 200 len: 1667 microversion: 2.1 time: 0.150870 Jul 21 10:56:52.699407 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 541/1071] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:56:52 2022] GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a => generated 1667 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:57:24.711338 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-6b284dba-a3a0-443e-b02a-8041e4040f40 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:57:24.712255 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-6b284dba-a3a0-443e-b02a-8041e4040f40 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] [instance: 5ec19443-8399-4f5f-b530-179ac8488e8a] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:57:24.714580 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_api:SELECT=16 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:57:24.715215 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:57:24.719888 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6b284dba-a3a0-443e-b02a-8041e4040f40 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:57:24.720375 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6b284dba-a3a0-443e-b02a-8041e4040f40 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:57:24.726925 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6b284dba-a3a0-443e-b02a-8041e4040f40 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:57:24.726925 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-6b284dba-a3a0-443e-b02a-8041e4040f40 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:57:24.750532 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-6b284dba-a3a0-443e-b02a-8041e4040f40 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] 10.222.0.48 "GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044573 Jul 21 10:57:24.751089 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 531/1072] 10.222.0.48 () {58 vars in 1301 bytes} [Thu Jul 21 10:57:24 2022] GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 21 10:57:24.808933 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-35cd7f2d-6bbe-4712-98ef-4b21cabe2804 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:57:24.809489 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-35cd7f2d-6bbe-4712-98ef-4b21cabe2804 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] [instance: 5ec19443-8399-4f5f-b530-179ac8488e8a] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:57:24.811549 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_api:SELECT=18 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:57:24.812318 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell1:SELECT=57,nova_cell1:INSERT=1 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:57:24.817433 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-35cd7f2d-6bbe-4712-98ef-4b21cabe2804 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:57:24.823998 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-35cd7f2d-6bbe-4712-98ef-4b21cabe2804 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:57:24.823998 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-35cd7f2d-6bbe-4712-98ef-4b21cabe2804 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:57:24.823998 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-35cd7f2d-6bbe-4712-98ef-4b21cabe2804 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:57:24.843647 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-35cd7f2d-6bbe-4712-98ef-4b21cabe2804 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] [instance: 5ec19443-8399-4f5f-b530-179ac8488e8a] Going to try to terminate instance {{(pid=124867) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 10:57:25.158234 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-35cd7f2d-6bbe-4712-98ef-4b21cabe2804 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] 10.222.0.48 "DELETE /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a" status: 204 len: 0 microversion: 2.1 time: 0.353127 Jul 21 10:57:25.158850 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 542/1073] 10.222.0.48 () {58 vars in 1238 bytes} [Thu Jul 21 10:57:24 2022] DELETE /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a => generated 0 bytes in 355 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 10:57:25.172498 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-170700e7-6396-43df-be26-ef8640b3d675 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:57:25.172498 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-170700e7-6396-43df-be26-ef8640b3d675 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] [instance: 5ec19443-8399-4f5f-b530-179ac8488e8a] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:57:25.175419 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-170700e7-6396-43df-be26-ef8640b3d675 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:57:25.175871 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-170700e7-6396-43df-be26-ef8640b3d675 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:57:25.177269 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-170700e7-6396-43df-be26-ef8640b3d675 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:57:25.177698 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-170700e7-6396-43df-be26-ef8640b3d675 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:57:25.315973 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-170700e7-6396-43df-be26-ef8640b3d675 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d76fa94b5ff4721bf490efd0699688e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3ae8ed116141658017f823c633c2f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:57:25.324249 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-170700e7-6396-43df-be26-ef8640b3d675 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] 10.222.0.48 "GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a" status: 200 len: 1673 microversion: 2.1 time: 0.160456 Jul 21 10:57:25.324810 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 532/1074] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:57:25 2022] GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a => generated 1673 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:57:26.343904 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-a64e1a61-ff30-4307-939c-0a1991766e18 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:57:26.344594 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-a64e1a61-ff30-4307-939c-0a1991766e18 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] [instance: 5ec19443-8399-4f5f-b530-179ac8488e8a] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:57:26.351668 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a64e1a61-ff30-4307-939c-0a1991766e18 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:57:26.352112 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a64e1a61-ff30-4307-939c-0a1991766e18 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:57:26.352892 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a64e1a61-ff30-4307-939c-0a1991766e18 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:57:26.353348 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a64e1a61-ff30-4307-939c-0a1991766e18 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:57:26.486183 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-a64e1a61-ff30-4307-939c-0a1991766e18 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d76fa94b5ff4721bf490efd0699688e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3ae8ed116141658017f823c633c2f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:57:26.494123 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-a64e1a61-ff30-4307-939c-0a1991766e18 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] 10.222.0.48 "GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a" status: 200 len: 1673 microversion: 2.1 time: 0.154382 Jul 21 10:57:26.494709 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 543/1075] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:57:26 2022] GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a => generated 1673 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:57:27.511905 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-b76cad88-3523-4798-8fd3-a92e43f075ad tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:57:27.512489 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-b76cad88-3523-4798-8fd3-a92e43f075ad tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] [instance: 5ec19443-8399-4f5f-b530-179ac8488e8a] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:57:27.519090 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b76cad88-3523-4798-8fd3-a92e43f075ad tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:57:27.519538 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b76cad88-3523-4798-8fd3-a92e43f075ad tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:57:27.520313 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b76cad88-3523-4798-8fd3-a92e43f075ad tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:57:27.520838 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b76cad88-3523-4798-8fd3-a92e43f075ad tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:57:27.656929 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-b76cad88-3523-4798-8fd3-a92e43f075ad tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d76fa94b5ff4721bf490efd0699688e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3ae8ed116141658017f823c633c2f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:57:27.664470 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-b76cad88-3523-4798-8fd3-a92e43f075ad tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] 10.222.0.48 "GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a" status: 200 len: 1673 microversion: 2.1 time: 0.156539 Jul 21 10:57:27.665035 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 533/1076] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:57:27 2022] GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a => generated 1673 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:57:28.307059 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [req-7465c93c-95d9-4412-b3b0-82aa9630fb88 req-0f7b8227-d829-407c-b7ad-de07521efd88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ec19443-8399-4f5f-b530-179ac8488e8a", "name": "network-vif-deleted", "tag": "9413091b-0c11-431b-a541-d2ab3dd8bc2f"}]} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:57:28.320422 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-7465c93c-95d9-4412-b3b0-82aa9630fb88 req-0f7b8227-d829-407c-b7ad-de07521efd88 service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:57:28.321151 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-7465c93c-95d9-4412-b3b0-82aa9630fb88 req-0f7b8227-d829-407c-b7ad-de07521efd88 service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:57:28.333401 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.compute.server_external_events [req-7465c93c-95d9-4412-b3b0-82aa9630fb88 req-0f7b8227-d829-407c-b7ad-de07521efd88 service nova] Creating event network-vif-deleted:9413091b-0c11-431b-a541-d2ab3dd8bc2f for instance 5ec19443-8399-4f5f-b530-179ac8488e8a on hv-cinder-84980 Jul 21 10:57:28.339071 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [req-7465c93c-95d9-4412-b3b0-82aa9630fb88 req-0f7b8227-d829-407c-b7ad-de07521efd88 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090908 Jul 21 10:57:28.343686 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 544/1077] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 21 10:57:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:57:28.681919 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-de22de13-5430-4863-bf22-ac4295101c89 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:57:28.682612 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-de22de13-5430-4863-bf22-ac4295101c89 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] [instance: 5ec19443-8399-4f5f-b530-179ac8488e8a] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:57:28.689423 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-de22de13-5430-4863-bf22-ac4295101c89 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:57:28.690324 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-de22de13-5430-4863-bf22-ac4295101c89 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:57:28.691144 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-de22de13-5430-4863-bf22-ac4295101c89 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:57:28.691582 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-de22de13-5430-4863-bf22-ac4295101c89 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:57:28.726002 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-de22de13-5430-4863-bf22-ac4295101c89 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:57:28.726449 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-de22de13-5430-4863-bf22-ac4295101c89 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:57:28.726928 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.objects.instance [None req-de22de13-5430-4863-bf22-ac4295101c89 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lazy-loading 'fault' on Instance uuid 5ec19443-8399-4f5f-b530-179ac8488e8a {{(pid=124868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 10:57:28.769774 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-de22de13-5430-4863-bf22-ac4295101c89 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d76fa94b5ff4721bf490efd0699688e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3ae8ed116141658017f823c633c2f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:57:28.778036 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-de22de13-5430-4863-bf22-ac4295101c89 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] 10.222.0.48 "GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a" status: 200 len: 1326 microversion: 2.1 time: 0.100602 Jul 21 10:57:28.778963 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 534/1078] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:57:28 2022] GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a => generated 1326 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:57:29.795996 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-cd175c8f-1d21-4c1e-b2da-a4291a97ecdf tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:57:29.796687 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-cd175c8f-1d21-4c1e-b2da-a4291a97ecdf tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] [instance: 5ec19443-8399-4f5f-b530-179ac8488e8a] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:57:29.802848 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-cd175c8f-1d21-4c1e-b2da-a4291a97ecdf tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:57:29.803298 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-cd175c8f-1d21-4c1e-b2da-a4291a97ecdf tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:57:29.804055 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-cd175c8f-1d21-4c1e-b2da-a4291a97ecdf tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:57:29.804502 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-cd175c8f-1d21-4c1e-b2da-a4291a97ecdf tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:57:29.817457 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.wsgi [None req-cd175c8f-1d21-4c1e-b2da-a4291a97ecdf tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] HTTP exception thrown: Instance 5ec19443-8399-4f5f-b530-179ac8488e8a could not be found. Jul 21 10:57:29.819169 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-cd175c8f-1d21-4c1e-b2da-a4291a97ecdf tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Request method failure captured: Jul 21 10:57:29.819169 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: request: GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a HTTP/1.1 Jul 21 10:57:29.819169 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Accept: application/json Jul 21 10:57:29.819169 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Accept-Encoding: identity Jul 21 10:57:29.819169 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Connection: close Jul 21 10:57:29.819169 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Content-Length: 0 Jul 21 10:57:29.819169 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Content-Type: application/json Jul 21 10:57:29.819169 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Host: 10.222.0.48 Jul 21 10:57:29.819169 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Openstack-System-Scope: None Jul 21 10:57:29.819169 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: User-Agent: python-urllib3/1.26.9 Jul 21 10:57:29.819169 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Auth-Token: gAAAAABi2TBnI5ZXFTuL-39INNZTI_QY7RIYH_Ky2pqCGymC2JyBDMNLdRcc7i6q2Vfz_Od8YaNaeLZ56DjYc6wD8wxJ8crQNVUQRMurDwwP8Bb7Ta6-lfMBRHWyuqkPfLJg_FiqJ6pd2A8mfmCkGT5cy1SyDecBHNUD-0LXOI9ggP4LUHv6_SY Jul 21 10:57:29.819169 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Domain-Id: None Jul 21 10:57:29.819169 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Domain-Name: None Jul 21 10:57:29.819169 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Identity-Status: Confirmed Jul 21 10:57:29.819169 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Is-Admin-Project: True Jul 21 10:57:29.819169 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Project-Domain-Id: default Jul 21 10:57:29.819169 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Project-Domain-Name: Default Jul 21 10:57:29.819169 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Project-Id: ce3ae8ed116141658017f823c633c2f2 Jul 21 10:57:29.819169 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Project-Name: tempest-AttachVolumeTestJSON-1108399766 Jul 21 10:57:29.819169 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Role: reader,member Jul 21 10:57:29.819169 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Roles: reader,member Jul 21 10:57:29.820855 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ce3ae8ed116141658017f823c633c2f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ce3ae8ed116141658017f823c633c2f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ce3ae8ed116141658017f823c633c2f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ce3ae8ed116141658017f823c633c2f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] Jul 21 10:57:29.820855 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Tenant: tempest-AttachVolumeTestJSON-1108399766 Jul 21 10:57:29.820855 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Tenant-Id: ce3ae8ed116141658017f823c633c2f2 Jul 21 10:57:29.820855 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1108399766 Jul 21 10:57:29.820855 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User: tempest-AttachVolumeTestJSON-1108399766-project Jul 21 10:57:29.820855 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User-Domain-Id: default Jul 21 10:57:29.820855 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User-Domain-Name: Default Jul 21 10:57:29.820855 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User-Id: 0d76fa94b5ff4721bf490efd0699688e Jul 21 10:57:29.820855 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User-Name: tempest-AttachVolumeTestJSON-1108399766-project Jul 21 10:57:29.820855 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: method: > Jul 21 10:57:29.820855 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: exception: Instance 5ec19443-8399-4f5f-b530-179ac8488e8a could not be found. Jul 21 10:57:29.820855 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: action_args: {'id': '5ec19443-8399-4f5f-b530-179ac8488e8a'} Jul 21 10:57:29.821931 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 10:57:29.821931 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:57:29.821931 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 10:57:29.821931 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 10:57:29.821931 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 10:57:29.821931 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 10:57:29.821931 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 10:57:29.821931 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 10:57:29.821931 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 10:57:29.821931 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 10:57:29.821931 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ec19443-8399-4f5f-b530-179ac8488e8a could not be found. Jul 21 10:57:29.821931 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:57:29.821931 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:57:29.821931 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:57:29.821931 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:57:29.821931 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:57:29.821931 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:57:29.821931 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 10:57:29.821931 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 10:57:29.821931 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 10:57:29.823918 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 10:57:29.823918 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 10:57:29.823918 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 10:57:29.823918 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 10:57:29.823918 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 10:57:29.823918 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 10:57:29.823918 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 10:57:29.823918 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ec19443-8399-4f5f-b530-179ac8488e8a could not be found. Jul 21 10:57:29.823918 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:57:29.823918 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:57:29.823918 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:57:29.823918 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:57:29.823918 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:57:29.823918 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:57:29.823918 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 10:57:29.823918 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 10:57:29.823918 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ec19443-8399-4f5f-b530-179ac8488e8a could not be found. Jul 21 10:57:29.823918 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:57:29.825673 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-cd175c8f-1d21-4c1e-b2da-a4291a97ecdf tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Returning 404 to user: Instance 5ec19443-8399-4f5f-b530-179ac8488e8a could not be found. {{(pid=124867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 10:57:29.825673 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-cd175c8f-1d21-4c1e-b2da-a4291a97ecdf tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] 10.222.0.48 "GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a" status: 404 len: 111 microversion: 2.1 time: 0.029175 Jul 21 10:57:29.825673 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 545/1079] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:57:29 2022] GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 10:57:29.829440 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-3d63aec0-2a62-421e-8745-3ac3b35d43e6 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Calling method '.version_select at 0x7f7962b97ee0>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:57:29.833255 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3d63aec0-2a62-421e-8745-3ac3b35d43e6 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] [be676d6c-7627-4001-9349-609e26e0ae53] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 21 10:57:30.840688 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO oslo.messaging._drivers.impl_rabbit [None req-3d63aec0-2a62-421e-8745-3ac3b35d43e6 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] [be676d6c-7627-4001-9349-609e26e0ae53] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 38358. Jul 21 10:57:30.936565 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-3d63aec0-2a62-421e-8745-3ac3b35d43e6 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-182587622" status: 202 len: 0 microversion: 2.1 time: 1.110899 Jul 21 10:57:30.937160 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 535/1080] 10.222.0.48 () {58 vars in 1217 bytes} [Thu Jul 21 10:57:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-182587622 => generated 0 bytes in 1112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 10:57:31.703115 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-aa8501f5-707b-49a7-ae9f-4cfc88934c4c tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Action: 'create', calling method: .version_select at 0x7f795ea369d0>, body: {"keypair": {"name": "tempest-keypair-1938726888", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLHuvoopBE+KcBe8Li6rz4n98ocWKVSnvjx44aAJxcPT87X1E8n6VWaw7djBJWFhrpH3mpKG5lZGuashRoV5TfkoWARfCYoxNEBBYugmxsGQBZEbGPTbMGJecmnVhGg77g=="}} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:57:31.718191 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.quota [None req-aa8501f5-707b-49a7-ae9f-4cfc88934c4c tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Getting quotas for project ce3ae8ed116141658017f823c633c2f2. Resources: {'key_pairs'} {{(pid=124867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 10:57:31.721874 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.quota [None req-aa8501f5-707b-49a7-ae9f-4cfc88934c4c tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Getting quotas for user 0d76fa94b5ff4721bf490efd0699688e and project ce3ae8ed116141658017f823c633c2f2. Resources: {'key_pairs'} {{(pid=124867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 10:57:31.809858 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-aa8501f5-707b-49a7-ae9f-4cfc88934c4c tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.110563 Jul 21 10:57:31.810379 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 546/1081] 10.222.0.48 () {60 vars in 1158 bytes} [Thu Jul 21 10:57:31 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:57:33.986374 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-196939c5-1f12-4965-af70-c03ffa8ad95b tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-474782740", "imageRef": "282ddb30-fa0f-489d-9cc3-a3e70e03c631", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fcf758b3-d1d0-4113-88a1-91bfb5fdc377"}], "security_groups": [{"name": "tempest-securitygroup--1236966579"}], "key_name": "tempest-keypair-1938726888", "user_data": "}} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:57:34.088422 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.network.neutron [None req-196939c5-1f12-4965-af70-c03ffa8ad95b tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] validate_networks() for [('fcf758b3-d1d0-4113-88a1-91bfb5fdc377', None, None, None, None, None)] {{(pid=124868) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 10:57:34.513388 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.virt.hardware [None req-196939c5-1f12-4965-af70-c03ffa8ad95b tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Flavor limits 0:0:0 {{(pid=124868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 10:57:34.513757 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.virt.hardware [None req-196939c5-1f12-4965-af70-c03ffa8ad95b tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Image limits 0:0:0 {{(pid=124868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 10:57:34.514232 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.virt.hardware [None req-196939c5-1f12-4965-af70-c03ffa8ad95b tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Flavor pref 0:0:0 {{(pid=124868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 10:57:34.514670 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.virt.hardware [None req-196939c5-1f12-4965-af70-c03ffa8ad95b tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Image pref 0:0:0 {{(pid=124868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 10:57:34.515082 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.virt.hardware [None req-196939c5-1f12-4965-af70-c03ffa8ad95b tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 10:57:34.523948 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-196939c5-1f12-4965-af70-c03ffa8ad95b tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:57:34.524399 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-196939c5-1f12-4965-af70-c03ffa8ad95b tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:57:34.525207 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-196939c5-1f12-4965-af70-c03ffa8ad95b tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:57:34.525644 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-196939c5-1f12-4965-af70-c03ffa8ad95b tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:57:34.543134 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.quota [None req-196939c5-1f12-4965-af70-c03ffa8ad95b tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Getting quotas for project ce3ae8ed116141658017f823c633c2f2. Resources: {'ram', 'instances', 'cores'} {{(pid=124868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 10:57:34.546969 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.quota [None req-196939c5-1f12-4965-af70-c03ffa8ad95b tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Getting quotas for user 0d76fa94b5ff4721bf490efd0699688e and project ce3ae8ed116141658017f823c633c2f2. Resources: {'ram', 'instances', 'cores'} {{(pid=124868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 10:57:34.558423 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-196939c5-1f12-4965-af70-c03ffa8ad95b tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Going to run 1 instances... {{(pid=124868) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 10:57:34.561221 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-196939c5-1f12-4965-af70-c03ffa8ad95b tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] [instance: c655f0ec-4155-4f8c-8672-2014f6ea1316] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='282ddb30-fa0f-489d-9cc3-a3e70e03c631',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 10:57:34.690344 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-196939c5-1f12-4965-af70-c03ffa8ad95b tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.708758 Jul 21 10:57:34.691530 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 536/1082] 10.222.0.48 () {60 vars in 1146 bytes} [Thu Jul 21 10:57:33 2022] POST /compute/v2.1/servers => generated 402 bytes in 710 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 10:57:34.702122 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-f785bf9b-9088-4898-9dd0-1fb04bc319f3 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:57:34.702800 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-f785bf9b-9088-4898-9dd0-1fb04bc319f3 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] [instance: c655f0ec-4155-4f8c-8672-2014f6ea1316] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:57:34.761186 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-f785bf9b-9088-4898-9dd0-1fb04bc319f3 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d76fa94b5ff4721bf490efd0699688e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3ae8ed116141658017f823c633c2f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:57:34.767876 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-f785bf9b-9088-4898-9dd0-1fb04bc319f3 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] 10.222.0.48 "GET /compute/v2.1/servers/c655f0ec-4155-4f8c-8672-2014f6ea1316" status: 200 len: 1237 microversion: 2.1 time: 0.070200 Jul 21 10:57:34.768362 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 547/1083] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:57:34 2022] GET /compute/v2.1/servers/c655f0ec-4155-4f8c-8672-2014f6ea1316 => generated 1237 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:57:35.785682 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-332b3104-7564-460e-a4b1-ccb57750c5f2 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:57:35.786349 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-332b3104-7564-460e-a4b1-ccb57750c5f2 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] [instance: c655f0ec-4155-4f8c-8672-2014f6ea1316] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:57:35.792686 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-332b3104-7564-460e-a4b1-ccb57750c5f2 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:57:35.793138 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-332b3104-7564-460e-a4b1-ccb57750c5f2 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:57:35.793913 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-332b3104-7564-460e-a4b1-ccb57750c5f2 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:57:35.794518 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-332b3104-7564-460e-a4b1-ccb57750c5f2 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:57:35.861549 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-332b3104-7564-460e-a4b1-ccb57750c5f2 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d76fa94b5ff4721bf490efd0699688e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3ae8ed116141658017f823c633c2f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:57:35.869641 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-332b3104-7564-460e-a4b1-ccb57750c5f2 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] 10.222.0.48 "GET /compute/v2.1/servers/c655f0ec-4155-4f8c-8672-2014f6ea1316" status: 200 len: 1241 microversion: 2.1 time: 0.088310 Jul 21 10:57:35.870222 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 537/1084] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:57:35 2022] GET /compute/v2.1/servers/c655f0ec-4155-4f8c-8672-2014f6ea1316 => generated 1241 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:57:36.887836 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-2b70728e-dffb-433b-b70c-5f3909294a22 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:57:36.888222 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-2b70728e-dffb-433b-b70c-5f3909294a22 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] [instance: c655f0ec-4155-4f8c-8672-2014f6ea1316] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:57:36.895106 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2b70728e-dffb-433b-b70c-5f3909294a22 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:57:36.895556 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2b70728e-dffb-433b-b70c-5f3909294a22 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:57:36.896326 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2b70728e-dffb-433b-b70c-5f3909294a22 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:57:36.896755 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-2b70728e-dffb-433b-b70c-5f3909294a22 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:57:36.960877 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-2b70728e-dffb-433b-b70c-5f3909294a22 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d76fa94b5ff4721bf490efd0699688e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3ae8ed116141658017f823c633c2f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:57:36.968882 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-2b70728e-dffb-433b-b70c-5f3909294a22 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] 10.222.0.48 "GET /compute/v2.1/servers/c655f0ec-4155-4f8c-8672-2014f6ea1316" status: 200 len: 1295 microversion: 2.1 time: 0.086221 Jul 21 10:57:36.969451 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 548/1085] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:57:36 2022] GET /compute/v2.1/servers/c655f0ec-4155-4f8c-8672-2014f6ea1316 => generated 1295 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:57:37.985672 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-bb4fa1cf-b7ab-4b41-a98e-02d63331cd7c tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:57:37.986290 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-bb4fa1cf-b7ab-4b41-a98e-02d63331cd7c tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] [instance: c655f0ec-4155-4f8c-8672-2014f6ea1316] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:57:37.993299 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-bb4fa1cf-b7ab-4b41-a98e-02d63331cd7c tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:57:37.993739 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-bb4fa1cf-b7ab-4b41-a98e-02d63331cd7c tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:57:37.994516 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-bb4fa1cf-b7ab-4b41-a98e-02d63331cd7c tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:57:37.994980 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-bb4fa1cf-b7ab-4b41-a98e-02d63331cd7c tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:57:38.129675 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-bb4fa1cf-b7ab-4b41-a98e-02d63331cd7c tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d76fa94b5ff4721bf490efd0699688e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3ae8ed116141658017f823c633c2f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:57:38.138279 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-bb4fa1cf-b7ab-4b41-a98e-02d63331cd7c tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] 10.222.0.48 "GET /compute/v2.1/servers/c655f0ec-4155-4f8c-8672-2014f6ea1316" status: 200 len: 1363 microversion: 2.1 time: 0.156514 Jul 21 10:57:38.139304 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 538/1086] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:57:37 2022] GET /compute/v2.1/servers/c655f0ec-4155-4f8c-8672-2014f6ea1316 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:57:38.180237 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [req-306d11bd-1963-44dc-9041-3f2e956ce930 req-97c539e3-b0c5-4316-a2ac-c951bed4ef95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c655f0ec-4155-4f8c-8672-2014f6ea1316", "tag": "2155410f-78ee-46db-8356-a84ec028f65e"}]} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:57:38.190139 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-306d11bd-1963-44dc-9041-3f2e956ce930 req-97c539e3-b0c5-4316-a2ac-c951bed4ef95 service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:57:38.190910 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-306d11bd-1963-44dc-9041-3f2e956ce930 req-97c539e3-b0c5-4316-a2ac-c951bed4ef95 service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:57:38.205961 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.compute.server_external_events [req-306d11bd-1963-44dc-9041-3f2e956ce930 req-97c539e3-b0c5-4316-a2ac-c951bed4ef95 service nova] Creating event network-changed:2155410f-78ee-46db-8356-a84ec028f65e for instance c655f0ec-4155-4f8c-8672-2014f6ea1316 on hv-cinder-84980 Jul 21 10:57:38.211416 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [req-306d11bd-1963-44dc-9041-3f2e956ce930 req-97c539e3-b0c5-4316-a2ac-c951bed4ef95 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035333 Jul 21 10:57:38.212007 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 549/1087] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 21 10:57:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:57:39.155667 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-93a33685-0882-41a2-bb6c-acacbd08272f tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:57:39.156277 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-93a33685-0882-41a2-bb6c-acacbd08272f tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] [instance: c655f0ec-4155-4f8c-8672-2014f6ea1316] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:57:39.163303 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-93a33685-0882-41a2-bb6c-acacbd08272f tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:57:39.163759 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-93a33685-0882-41a2-bb6c-acacbd08272f tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:57:39.164634 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-93a33685-0882-41a2-bb6c-acacbd08272f tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:57:39.165104 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-93a33685-0882-41a2-bb6c-acacbd08272f tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:57:39.296180 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-93a33685-0882-41a2-bb6c-acacbd08272f tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d76fa94b5ff4721bf490efd0699688e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3ae8ed116141658017f823c633c2f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:57:39.303654 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-93a33685-0882-41a2-bb6c-acacbd08272f tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] 10.222.0.48 "GET /compute/v2.1/servers/c655f0ec-4155-4f8c-8672-2014f6ea1316" status: 200 len: 1363 microversion: 2.1 time: 0.151831 Jul 21 10:57:39.304221 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 539/1088] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:57:39 2022] GET /compute/v2.1/servers/c655f0ec-4155-4f8c-8672-2014f6ea1316 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:57:40.321548 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-99ac1cfe-5a09-4626-a6ad-fb2d2d134ca3 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:57:40.322235 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-99ac1cfe-5a09-4626-a6ad-fb2d2d134ca3 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] [instance: c655f0ec-4155-4f8c-8672-2014f6ea1316] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:57:40.328428 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-99ac1cfe-5a09-4626-a6ad-fb2d2d134ca3 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:57:40.328873 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-99ac1cfe-5a09-4626-a6ad-fb2d2d134ca3 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:57:40.329627 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-99ac1cfe-5a09-4626-a6ad-fb2d2d134ca3 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:57:40.330069 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-99ac1cfe-5a09-4626-a6ad-fb2d2d134ca3 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:57:40.460719 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-99ac1cfe-5a09-4626-a6ad-fb2d2d134ca3 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d76fa94b5ff4721bf490efd0699688e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3ae8ed116141658017f823c633c2f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:57:40.468889 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-99ac1cfe-5a09-4626-a6ad-fb2d2d134ca3 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] 10.222.0.48 "GET /compute/v2.1/servers/c655f0ec-4155-4f8c-8672-2014f6ea1316" status: 200 len: 1363 microversion: 2.1 time: 0.152031 Jul 21 10:57:40.469446 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 550/1089] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:57:40 2022] GET /compute/v2.1/servers/c655f0ec-4155-4f8c-8672-2014f6ea1316 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:57:41.485382 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-07b9bc84-783a-4d20-9bc5-d576623dd7de tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:57:41.485926 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-07b9bc84-783a-4d20-9bc5-d576623dd7de tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] [instance: c655f0ec-4155-4f8c-8672-2014f6ea1316] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:57:41.493350 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-07b9bc84-783a-4d20-9bc5-d576623dd7de tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:57:41.493801 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-07b9bc84-783a-4d20-9bc5-d576623dd7de tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:57:41.494589 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-07b9bc84-783a-4d20-9bc5-d576623dd7de tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:57:41.495028 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-07b9bc84-783a-4d20-9bc5-d576623dd7de tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:57:41.621842 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-07b9bc84-783a-4d20-9bc5-d576623dd7de tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d76fa94b5ff4721bf490efd0699688e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3ae8ed116141658017f823c633c2f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:57:41.629347 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-07b9bc84-783a-4d20-9bc5-d576623dd7de tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] 10.222.0.48 "GET /compute/v2.1/servers/c655f0ec-4155-4f8c-8672-2014f6ea1316" status: 200 len: 1363 microversion: 2.1 time: 0.147990 Jul 21 10:57:41.629916 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 540/1090] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:57:41 2022] GET /compute/v2.1/servers/c655f0ec-4155-4f8c-8672-2014f6ea1316 => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:57:42.646750 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-ec79cc23-8957-4080-8dcd-3d56133a1f48 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:57:42.647298 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-ec79cc23-8957-4080-8dcd-3d56133a1f48 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] [instance: c655f0ec-4155-4f8c-8672-2014f6ea1316] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:57:42.654468 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ec79cc23-8957-4080-8dcd-3d56133a1f48 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:57:42.654947 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ec79cc23-8957-4080-8dcd-3d56133a1f48 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:57:42.655702 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ec79cc23-8957-4080-8dcd-3d56133a1f48 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:57:42.656138 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-ec79cc23-8957-4080-8dcd-3d56133a1f48 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:57:42.785534 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-ec79cc23-8957-4080-8dcd-3d56133a1f48 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d76fa94b5ff4721bf490efd0699688e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3ae8ed116141658017f823c633c2f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:57:42.793148 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-ec79cc23-8957-4080-8dcd-3d56133a1f48 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] 10.222.0.48 "GET /compute/v2.1/servers/c655f0ec-4155-4f8c-8672-2014f6ea1316" status: 200 len: 1363 microversion: 2.1 time: 0.150336 Jul 21 10:57:42.793699 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 551/1091] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:57:42 2022] GET /compute/v2.1/servers/c655f0ec-4155-4f8c-8672-2014f6ea1316 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:57:43.809779 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-2aa49d4a-5748-47f2-a804-4ba5b657eac6 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:57:43.810603 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-2aa49d4a-5748-47f2-a804-4ba5b657eac6 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] [instance: c655f0ec-4155-4f8c-8672-2014f6ea1316] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:57:43.817354 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-2aa49d4a-5748-47f2-a804-4ba5b657eac6 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:57:43.817796 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-2aa49d4a-5748-47f2-a804-4ba5b657eac6 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:57:43.818768 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-2aa49d4a-5748-47f2-a804-4ba5b657eac6 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:57:43.819204 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-2aa49d4a-5748-47f2-a804-4ba5b657eac6 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:57:43.953837 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-2aa49d4a-5748-47f2-a804-4ba5b657eac6 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d76fa94b5ff4721bf490efd0699688e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3ae8ed116141658017f823c633c2f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:57:43.961828 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-2aa49d4a-5748-47f2-a804-4ba5b657eac6 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] 10.222.0.48 "GET /compute/v2.1/servers/c655f0ec-4155-4f8c-8672-2014f6ea1316" status: 200 len: 1363 microversion: 2.1 time: 0.155885 Jul 21 10:57:43.963963 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 541/1092] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:57:43 2022] GET /compute/v2.1/servers/c655f0ec-4155-4f8c-8672-2014f6ea1316 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:57:43.987364 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [req-bcc6f36f-91da-49fc-8279-e2f3ce51c955 req-c289ebd4-c3d6-4110-ac53-a7d55b18ca3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c655f0ec-4155-4f8c-8672-2014f6ea1316", "name": "network-vif-plugged", "status": "completed", "tag": "2155410f-78ee-46db-8356-a84ec028f65e"}]} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:57:43.995776 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-bcc6f36f-91da-49fc-8279-e2f3ce51c955 req-c289ebd4-c3d6-4110-ac53-a7d55b18ca3f service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:57:43.996214 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-bcc6f36f-91da-49fc-8279-e2f3ce51c955 req-c289ebd4-c3d6-4110-ac53-a7d55b18ca3f service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:57:44.007015 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.compute.server_external_events [req-bcc6f36f-91da-49fc-8279-e2f3ce51c955 req-c289ebd4-c3d6-4110-ac53-a7d55b18ca3f service nova] Creating event network-vif-plugged:2155410f-78ee-46db-8356-a84ec028f65e for instance c655f0ec-4155-4f8c-8672-2014f6ea1316 on hv-cinder-84980 Jul 21 10:57:44.012671 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [req-bcc6f36f-91da-49fc-8279-e2f3ce51c955 req-c289ebd4-c3d6-4110-ac53-a7d55b18ca3f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091709 Jul 21 10:57:44.013261 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 552/1093] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 21 10:57:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 10:57:44.979273 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-d3e5975d-3514-43af-9070-5f82b2560084 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:57:44.979886 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-d3e5975d-3514-43af-9070-5f82b2560084 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] [instance: c655f0ec-4155-4f8c-8672-2014f6ea1316] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:57:44.981759 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell0:SELECT=2 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:57:44.982413 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell0:SELECT=6 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:57:44.987887 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d3e5975d-3514-43af-9070-5f82b2560084 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:57:44.995525 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d3e5975d-3514-43af-9070-5f82b2560084 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:57:44.995525 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d3e5975d-3514-43af-9070-5f82b2560084 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:57:44.995525 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d3e5975d-3514-43af-9070-5f82b2560084 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:57:45.122093 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-d3e5975d-3514-43af-9070-5f82b2560084 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d76fa94b5ff4721bf490efd0699688e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3ae8ed116141658017f823c633c2f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:57:45.129436 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-d3e5975d-3514-43af-9070-5f82b2560084 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] 10.222.0.48 "GET /compute/v2.1/servers/c655f0ec-4155-4f8c-8672-2014f6ea1316" status: 200 len: 1363 microversion: 2.1 time: 0.154763 Jul 21 10:57:45.131919 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 542/1094] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:57:44 2022] GET /compute/v2.1/servers/c655f0ec-4155-4f8c-8672-2014f6ea1316 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:57:46.144438 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell0:SELECT=6 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:57:46.153636 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-7514bdf2-947c-4779-b764-db565b710284 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:57:46.153636 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-7514bdf2-947c-4779-b764-db565b710284 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] [instance: c655f0ec-4155-4f8c-8672-2014f6ea1316] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:57:46.156312 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7514bdf2-947c-4779-b764-db565b710284 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:57:46.156752 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7514bdf2-947c-4779-b764-db565b710284 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:57:46.157504 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7514bdf2-947c-4779-b764-db565b710284 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:57:46.157935 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-7514bdf2-947c-4779-b764-db565b710284 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:57:46.287236 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-7514bdf2-947c-4779-b764-db565b710284 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d76fa94b5ff4721bf490efd0699688e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3ae8ed116141658017f823c633c2f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:57:46.295310 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-7514bdf2-947c-4779-b764-db565b710284 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] 10.222.0.48 "GET /compute/v2.1/servers/c655f0ec-4155-4f8c-8672-2014f6ea1316" status: 200 len: 1549 microversion: 2.1 time: 0.151776 Jul 21 10:57:46.295870 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 553/1095] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:57:46 2022] GET /compute/v2.1/servers/c655f0ec-4155-4f8c-8672-2014f6ea1316 => generated 1549 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:57:46.312043 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-b12b67ab-167c-4fb7-b4f1-60c64c2d10e8 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:57:46.312566 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-b12b67ab-167c-4fb7-b4f1-60c64c2d10e8 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] [instance: c655f0ec-4155-4f8c-8672-2014f6ea1316] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:57:46.318835 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b12b67ab-167c-4fb7-b4f1-60c64c2d10e8 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:57:46.319315 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b12b67ab-167c-4fb7-b4f1-60c64c2d10e8 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:57:46.320066 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b12b67ab-167c-4fb7-b4f1-60c64c2d10e8 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:57:46.321621 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b12b67ab-167c-4fb7-b4f1-60c64c2d10e8 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:57:46.400443 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-b12b67ab-167c-4fb7-b4f1-60c64c2d10e8 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] 10.222.0.48 "GET /compute/v2.1/servers/c655f0ec-4155-4f8c-8672-2014f6ea1316/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092091 Jul 21 10:57:46.401071 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 543/1096] 10.222.0.48 () {58 vars in 1274 bytes} [Thu Jul 21 10:57:46 2022] GET /compute/v2.1/servers/c655f0ec-4155-4f8c-8672-2014f6ea1316/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:57:47.424742 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [req-d7441122-ee9c-430a-939b-ff3fd2737687 req-cf71719b-ad17-45c9-82ff-983d3220be00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c655f0ec-4155-4f8c-8672-2014f6ea1316", "tag": "2155410f-78ee-46db-8356-a84ec028f65e"}]} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:57:47.433813 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-d7441122-ee9c-430a-939b-ff3fd2737687 req-cf71719b-ad17-45c9-82ff-983d3220be00 service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:57:47.434255 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-d7441122-ee9c-430a-939b-ff3fd2737687 req-cf71719b-ad17-45c9-82ff-983d3220be00 service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:57:47.446498 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.compute.server_external_events [req-d7441122-ee9c-430a-939b-ff3fd2737687 req-cf71719b-ad17-45c9-82ff-983d3220be00 service nova] Creating event network-changed:2155410f-78ee-46db-8356-a84ec028f65e for instance c655f0ec-4155-4f8c-8672-2014f6ea1316 on hv-cinder-84980 Jul 21 10:57:47.451803 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [req-d7441122-ee9c-430a-939b-ff3fd2737687 req-cf71719b-ad17-45c9-82ff-983d3220be00 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085585 Jul 21 10:57:47.452417 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 554/1097] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 21 10:57:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:58:11.189608 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_api:SELECT=42,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:58:11.190589 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell1:SELECT=68 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:58:11.194397 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-863bbe8b-b169-4ee4-a1f6-e56d7be4e0c8 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:58:11.194927 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-863bbe8b-b169-4ee4-a1f6-e56d7be4e0c8 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] [instance: 6ef47e35-a90e-4c42-9bbc-1e09a85d7d0e] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:58:11.200778 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-863bbe8b-b169-4ee4-a1f6-e56d7be4e0c8 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:58:11.201223 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-863bbe8b-b169-4ee4-a1f6-e56d7be4e0c8 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:58:11.201982 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-863bbe8b-b169-4ee4-a1f6-e56d7be4e0c8 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:58:11.202414 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-863bbe8b-b169-4ee4-a1f6-e56d7be4e0c8 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:58:11.229022 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-863bbe8b-b169-4ee4-a1f6-e56d7be4e0c8 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] [instance: 6ef47e35-a90e-4c42-9bbc-1e09a85d7d0e] Going to try to terminate instance {{(pid=124868) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 10:58:11.538532 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-863bbe8b-b169-4ee4-a1f6-e56d7be4e0c8 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] 10.222.0.48 "DELETE /compute/v2.1/servers/6ef47e35-a90e-4c42-9bbc-1e09a85d7d0e" status: 204 len: 0 microversion: 2.1 time: 0.350000 Jul 21 10:58:11.539211 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 544/1098] 10.222.0.48 () {58 vars in 1238 bytes} [Thu Jul 21 10:58:11 2022] DELETE /compute/v2.1/servers/6ef47e35-a90e-4c42-9bbc-1e09a85d7d0e => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 10:58:11.545406 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:58:11.547560 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:58:11.550066 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-8ff43edc-a462-4262-b9c7-0a0eb0c68eb8 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:58:11.550804 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-8ff43edc-a462-4262-b9c7-0a0eb0c68eb8 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] [instance: 6ef47e35-a90e-4c42-9bbc-1e09a85d7d0e] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:58:11.557109 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8ff43edc-a462-4262-b9c7-0a0eb0c68eb8 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:58:11.557557 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8ff43edc-a462-4262-b9c7-0a0eb0c68eb8 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:58:11.558316 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8ff43edc-a462-4262-b9c7-0a0eb0c68eb8 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:58:11.558784 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8ff43edc-a462-4262-b9c7-0a0eb0c68eb8 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:58:11.703339 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-8ff43edc-a462-4262-b9c7-0a0eb0c68eb8 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0aebc4614c448bdb77fb167d4ae3de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99e5deac07a429c9c771ef41d278a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:58:11.711643 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-8ff43edc-a462-4262-b9c7-0a0eb0c68eb8 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] 10.222.0.48 "GET /compute/v2.1/servers/6ef47e35-a90e-4c42-9bbc-1e09a85d7d0e" status: 200 len: 1577 microversion: 2.1 time: 0.167775 Jul 21 10:58:11.712200 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 555/1099] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:58:11 2022] GET /compute/v2.1/servers/6ef47e35-a90e-4c42-9bbc-1e09a85d7d0e => generated 1577 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:58:12.730018 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-05588664-5bd6-41d5-abb5-33c65f54ecef tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:58:12.730767 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-05588664-5bd6-41d5-abb5-33c65f54ecef tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] [instance: 6ef47e35-a90e-4c42-9bbc-1e09a85d7d0e] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:58:12.737344 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-05588664-5bd6-41d5-abb5-33c65f54ecef tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:58:12.737790 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-05588664-5bd6-41d5-abb5-33c65f54ecef tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:58:12.738583 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-05588664-5bd6-41d5-abb5-33c65f54ecef tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:58:12.739007 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-05588664-5bd6-41d5-abb5-33c65f54ecef tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:58:12.873612 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-05588664-5bd6-41d5-abb5-33c65f54ecef tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0aebc4614c448bdb77fb167d4ae3de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99e5deac07a429c9c771ef41d278a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:58:12.880998 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-05588664-5bd6-41d5-abb5-33c65f54ecef tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] 10.222.0.48 "GET /compute/v2.1/servers/6ef47e35-a90e-4c42-9bbc-1e09a85d7d0e" status: 200 len: 1577 microversion: 2.1 time: 0.155642 Jul 21 10:58:12.881706 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 545/1100] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:58:12 2022] GET /compute/v2.1/servers/6ef47e35-a90e-4c42-9bbc-1e09a85d7d0e => generated 1577 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:58:13.899480 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-dfc5d8a2-43b4-4856-9e5a-4eb6ae31bee7 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:58:13.900843 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-dfc5d8a2-43b4-4856-9e5a-4eb6ae31bee7 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] [instance: 6ef47e35-a90e-4c42-9bbc-1e09a85d7d0e] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:58:13.909510 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-dfc5d8a2-43b4-4856-9e5a-4eb6ae31bee7 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:58:13.910138 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-dfc5d8a2-43b4-4856-9e5a-4eb6ae31bee7 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:58:13.910944 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-dfc5d8a2-43b4-4856-9e5a-4eb6ae31bee7 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:58:13.911381 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-dfc5d8a2-43b4-4856-9e5a-4eb6ae31bee7 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:58:13.979527 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-dfc5d8a2-43b4-4856-9e5a-4eb6ae31bee7 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0aebc4614c448bdb77fb167d4ae3de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99e5deac07a429c9c771ef41d278a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:58:13.987434 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-dfc5d8a2-43b4-4856-9e5a-4eb6ae31bee7 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] 10.222.0.48 "GET /compute/v2.1/servers/6ef47e35-a90e-4c42-9bbc-1e09a85d7d0e" status: 200 len: 1510 microversion: 2.1 time: 0.093006 Jul 21 10:58:13.987943 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 556/1101] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:58:13 2022] GET /compute/v2.1/servers/6ef47e35-a90e-4c42-9bbc-1e09a85d7d0e => generated 1510 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:58:14.462591 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [req-e84a5d46-2a5c-407a-97f2-b55717b0b985 req-cb182020-27bb-47ea-b4b1-444d55b4a18a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ef47e35-a90e-4c42-9bbc-1e09a85d7d0e", "name": "network-vif-deleted", "tag": "ddef567e-1162-4e85-93ce-7def8406c8b9"}]} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:58:14.472666 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-e84a5d46-2a5c-407a-97f2-b55717b0b985 req-cb182020-27bb-47ea-b4b1-444d55b4a18a service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:58:14.473100 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-e84a5d46-2a5c-407a-97f2-b55717b0b985 req-cb182020-27bb-47ea-b4b1-444d55b4a18a service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:58:14.485175 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.compute.server_external_events [req-e84a5d46-2a5c-407a-97f2-b55717b0b985 req-cb182020-27bb-47ea-b4b1-444d55b4a18a service nova] Creating event network-vif-deleted:ddef567e-1162-4e85-93ce-7def8406c8b9 for instance 6ef47e35-a90e-4c42-9bbc-1e09a85d7d0e on hv-cinder-84980 Jul 21 10:58:14.500842 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [req-e84a5d46-2a5c-407a-97f2-b55717b0b985 req-cb182020-27bb-47ea-b4b1-444d55b4a18a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032207 Jul 21 10:58:14.500842 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 546/1102] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 21 10:58:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:58:15.005296 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-12272064-ed63-4d64-bd1d-ea8c549d8a80 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:58:15.005907 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-12272064-ed63-4d64-bd1d-ea8c549d8a80 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] [instance: 6ef47e35-a90e-4c42-9bbc-1e09a85d7d0e] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:58:15.012606 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-12272064-ed63-4d64-bd1d-ea8c549d8a80 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:58:15.013078 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-12272064-ed63-4d64-bd1d-ea8c549d8a80 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:58:15.013858 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-12272064-ed63-4d64-bd1d-ea8c549d8a80 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:58:15.014302 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-12272064-ed63-4d64-bd1d-ea8c549d8a80 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:58:15.080681 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-12272064-ed63-4d64-bd1d-ea8c549d8a80 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0aebc4614c448bdb77fb167d4ae3de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99e5deac07a429c9c771ef41d278a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:58:15.089158 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-12272064-ed63-4d64-bd1d-ea8c549d8a80 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] 10.222.0.48 "GET /compute/v2.1/servers/6ef47e35-a90e-4c42-9bbc-1e09a85d7d0e" status: 200 len: 1225 microversion: 2.1 time: 0.087770 Jul 21 10:58:15.089739 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 557/1103] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:58:15 2022] GET /compute/v2.1/servers/6ef47e35-a90e-4c42-9bbc-1e09a85d7d0e => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:58:16.107189 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-431fb7ae-a2b8-439a-ac8b-9a1cab351056 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:58:16.107887 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-431fb7ae-a2b8-439a-ac8b-9a1cab351056 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] [instance: 6ef47e35-a90e-4c42-9bbc-1e09a85d7d0e] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:58:16.114006 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-431fb7ae-a2b8-439a-ac8b-9a1cab351056 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:58:16.114455 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-431fb7ae-a2b8-439a-ac8b-9a1cab351056 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:58:16.115242 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-431fb7ae-a2b8-439a-ac8b-9a1cab351056 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:58:16.115681 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-431fb7ae-a2b8-439a-ac8b-9a1cab351056 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:58:16.129196 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.wsgi [None req-431fb7ae-a2b8-439a-ac8b-9a1cab351056 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] HTTP exception thrown: Instance 6ef47e35-a90e-4c42-9bbc-1e09a85d7d0e could not be found. Jul 21 10:58:16.130836 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-431fb7ae-a2b8-439a-ac8b-9a1cab351056 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Request method failure captured: Jul 21 10:58:16.130836 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: request: GET /compute/v2.1/servers/6ef47e35-a90e-4c42-9bbc-1e09a85d7d0e HTTP/1.1 Jul 21 10:58:16.130836 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Accept: application/json Jul 21 10:58:16.130836 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Accept-Encoding: identity Jul 21 10:58:16.130836 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Connection: close Jul 21 10:58:16.130836 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Content-Length: 0 Jul 21 10:58:16.130836 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Content-Type: application/json Jul 21 10:58:16.130836 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Host: 10.222.0.48 Jul 21 10:58:16.130836 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Openstack-System-Scope: None Jul 21 10:58:16.130836 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: User-Agent: python-urllib3/1.26.9 Jul 21 10:58:16.130836 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Auth-Token: gAAAAABi2TCh3XzGM6jHijsg2hWzsJtwhtPnT2DyLW3wj2wlseyOVcn9mJer3DWoWxAOIadJ7x8wrD-LlWyxmZATMSsj1DOFeE18t8k33-evamXfmTyFWGbKSF16rQXRD4TUUyEmjx78KLNIfiX7uISqDUHRNZrxF8FfpjGPXZ5pUb-KQPlQ-8s Jul 21 10:58:16.130836 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Domain-Id: None Jul 21 10:58:16.130836 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Domain-Name: None Jul 21 10:58:16.130836 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Identity-Status: Confirmed Jul 21 10:58:16.130836 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Is-Admin-Project: True Jul 21 10:58:16.130836 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Domain-Id: default Jul 21 10:58:16.130836 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Domain-Name: Default Jul 21 10:58:16.130836 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Id: c99e5deac07a429c9c771ef41d278a46 Jul 21 10:58:16.130836 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Name: tempest-TestVolumeBootPattern-786894644 Jul 21 10:58:16.130836 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Role: reader,member Jul 21 10:58:16.130836 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Roles: reader,member Jul 21 10:58:16.132534 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c99e5deac07a429c9c771ef41d278a46"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c99e5deac07a429c9c771ef41d278a46"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c99e5deac07a429c9c771ef41d278a46"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c99e5deac07a429c9c771ef41d278a46"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] Jul 21 10:58:16.132534 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Tenant: tempest-TestVolumeBootPattern-786894644 Jul 21 10:58:16.132534 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Tenant-Id: c99e5deac07a429c9c771ef41d278a46 Jul 21 10:58:16.132534 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Tenant-Name: tempest-TestVolumeBootPattern-786894644 Jul 21 10:58:16.132534 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User: tempest-TestVolumeBootPattern-786894644-project Jul 21 10:58:16.132534 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Domain-Id: default Jul 21 10:58:16.132534 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Domain-Name: Default Jul 21 10:58:16.132534 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Id: a0aebc4614c448bdb77fb167d4ae3de1 Jul 21 10:58:16.132534 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Name: tempest-TestVolumeBootPattern-786894644-project Jul 21 10:58:16.132534 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: method: > Jul 21 10:58:16.132534 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: exception: Instance 6ef47e35-a90e-4c42-9bbc-1e09a85d7d0e could not be found. Jul 21 10:58:16.132534 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: action_args: {'id': '6ef47e35-a90e-4c42-9bbc-1e09a85d7d0e'} Jul 21 10:58:16.133692 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 10:58:16.133692 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:58:16.133692 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 10:58:16.133692 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 10:58:16.133692 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 10:58:16.133692 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 10:58:16.133692 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 10:58:16.133692 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 10:58:16.133692 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 10:58:16.133692 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 10:58:16.133692 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ef47e35-a90e-4c42-9bbc-1e09a85d7d0e could not be found. Jul 21 10:58:16.133692 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:58:16.133692 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:58:16.133692 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:58:16.133692 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:58:16.133692 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:58:16.133692 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:58:16.133692 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 10:58:16.133692 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 10:58:16.133692 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 10:58:16.135360 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 10:58:16.135360 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 10:58:16.135360 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 10:58:16.135360 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 10:58:16.135360 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 10:58:16.135360 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 10:58:16.135360 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 10:58:16.135360 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ef47e35-a90e-4c42-9bbc-1e09a85d7d0e could not be found. Jul 21 10:58:16.135360 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:58:16.135360 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:58:16.135360 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:58:16.135360 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:58:16.135360 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:58:16.135360 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:58:16.135360 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 10:58:16.135360 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 10:58:16.135360 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ef47e35-a90e-4c42-9bbc-1e09a85d7d0e could not be found. Jul 21 10:58:16.135360 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:58:16.136767 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-431fb7ae-a2b8-439a-ac8b-9a1cab351056 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Returning 404 to user: Instance 6ef47e35-a90e-4c42-9bbc-1e09a85d7d0e could not be found. {{(pid=124868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 10:58:16.136767 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-431fb7ae-a2b8-439a-ac8b-9a1cab351056 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] 10.222.0.48 "GET /compute/v2.1/servers/6ef47e35-a90e-4c42-9bbc-1e09a85d7d0e" status: 404 len: 111 microversion: 2.1 time: 0.030241 Jul 21 10:58:16.136767 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 547/1104] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:58:16 2022] GET /compute/v2.1/servers/6ef47e35-a90e-4c42-9bbc-1e09a85d7d0e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 10:58:16.179319 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-307a13b7-c41e-4714-b02c-aacb84fe52bf tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-977848077", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-122371990", "security_groups": [{"name": "tempest-secgroup-smoke-926775298"}], "block_device_mapping_v2": [{"uuid": "8b7ec756-17d0-41fd-8d45-0656cac90a9a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "cc0b2a51-d561-47c8-bdc0-392c408f6063"}]}} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:58:16.291343 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.network.neutron [None req-307a13b7-c41e-4714-b02c-aacb84fe52bf tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] validate_networks() for [('cc0b2a51-d561-47c8-bdc0-392c408f6063', None, None, None, None, None)] {{(pid=124867) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 10:58:16.960021 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-307a13b7-c41e-4714-b02c-aacb84fe52bf tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Flavor limits 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 10:58:16.960444 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-307a13b7-c41e-4714-b02c-aacb84fe52bf tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Image limits 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 10:58:16.960910 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-307a13b7-c41e-4714-b02c-aacb84fe52bf tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Flavor pref 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 10:58:16.961442 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-307a13b7-c41e-4714-b02c-aacb84fe52bf tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Image pref 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 10:58:16.961923 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-307a13b7-c41e-4714-b02c-aacb84fe52bf tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 10:58:16.970736 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-307a13b7-c41e-4714-b02c-aacb84fe52bf tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:58:16.971178 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-307a13b7-c41e-4714-b02c-aacb84fe52bf tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:58:16.971994 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-307a13b7-c41e-4714-b02c-aacb84fe52bf tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:58:16.972421 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-307a13b7-c41e-4714-b02c-aacb84fe52bf tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:58:16.989254 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.quota [None req-307a13b7-c41e-4714-b02c-aacb84fe52bf tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Getting quotas for project c99e5deac07a429c9c771ef41d278a46. Resources: {'ram', 'instances', 'cores'} {{(pid=124867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 10:58:16.993893 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.quota [None req-307a13b7-c41e-4714-b02c-aacb84fe52bf tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Getting quotas for user a0aebc4614c448bdb77fb167d4ae3de1 and project c99e5deac07a429c9c771ef41d278a46. Resources: {'ram', 'instances', 'cores'} {{(pid=124867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 10:58:17.050414 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-307a13b7-c41e-4714-b02c-aacb84fe52bf tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Going to run 1 instances... {{(pid=124867) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 10:58:17.052520 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-307a13b7-c41e-4714-b02c-aacb84fe52bf tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] [instance: 20b5ce2d-dd53-4957-839f-b674794f29ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8b7ec756-17d0-41fd-8d45-0656cac90a9a',volume_size=None,volume_type=None)] {{(pid=124867) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 10:58:17.472646 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-307a13b7-c41e-4714-b02c-aacb84fe52bf tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.297018 Jul 21 10:58:17.473462 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 558/1105] 10.222.0.48 () {60 vars in 1146 bytes} [Thu Jul 21 10:58:16 2022] POST /compute/v2.1/servers => generated 405 bytes in 1299 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 10:58:17.485225 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-8f583ddb-e621-4158-aea4-c3253886ab1d tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:58:17.485818 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-8f583ddb-e621-4158-aea4-c3253886ab1d tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] [instance: 20b5ce2d-dd53-4957-839f-b674794f29ee] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:58:17.540637 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-8f583ddb-e621-4158-aea4-c3253886ab1d tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0aebc4614c448bdb77fb167d4ae3de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99e5deac07a429c9c771ef41d278a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:58:17.547497 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-8f583ddb-e621-4158-aea4-c3253886ab1d tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] 10.222.0.48 "GET /compute/v2.1/servers/20b5ce2d-dd53-4957-839f-b674794f29ee" status: 200 len: 1093 microversion: 2.1 time: 0.066383 Jul 21 10:58:17.548246 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 548/1106] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:58:17 2022] GET /compute/v2.1/servers/20b5ce2d-dd53-4957-839f-b674794f29ee => generated 1093 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:58:18.565258 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-88ff2c2f-56a8-40ba-98a6-ed49de343acc tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:58:18.565933 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-88ff2c2f-56a8-40ba-98a6-ed49de343acc tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] [instance: 20b5ce2d-dd53-4957-839f-b674794f29ee] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:58:18.572779 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-88ff2c2f-56a8-40ba-98a6-ed49de343acc tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:58:18.573228 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-88ff2c2f-56a8-40ba-98a6-ed49de343acc tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:58:18.573993 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-88ff2c2f-56a8-40ba-98a6-ed49de343acc tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:58:18.574428 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-88ff2c2f-56a8-40ba-98a6-ed49de343acc tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:58:18.636537 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-88ff2c2f-56a8-40ba-98a6-ed49de343acc tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0aebc4614c448bdb77fb167d4ae3de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99e5deac07a429c9c771ef41d278a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:58:18.644179 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-88ff2c2f-56a8-40ba-98a6-ed49de343acc tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] 10.222.0.48 "GET /compute/v2.1/servers/20b5ce2d-dd53-4957-839f-b674794f29ee" status: 200 len: 1135 microversion: 2.1 time: 0.083405 Jul 21 10:58:18.644774 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 559/1107] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:58:18 2022] GET /compute/v2.1/servers/20b5ce2d-dd53-4957-839f-b674794f29ee => generated 1135 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:58:19.661306 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-fa7df7c2-bd9a-43e8-ba31-fcef45c8391c tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:58:19.664727 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-fa7df7c2-bd9a-43e8-ba31-fcef45c8391c tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] [instance: 20b5ce2d-dd53-4957-839f-b674794f29ee] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:58:19.669261 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-fa7df7c2-bd9a-43e8-ba31-fcef45c8391c tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:58:19.669711 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-fa7df7c2-bd9a-43e8-ba31-fcef45c8391c tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:58:19.670471 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-fa7df7c2-bd9a-43e8-ba31-fcef45c8391c tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:58:19.670990 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-fa7df7c2-bd9a-43e8-ba31-fcef45c8391c tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:58:19.733320 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-fa7df7c2-bd9a-43e8-ba31-fcef45c8391c tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0aebc4614c448bdb77fb167d4ae3de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99e5deac07a429c9c771ef41d278a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:58:19.741123 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-fa7df7c2-bd9a-43e8-ba31-fcef45c8391c tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] 10.222.0.48 "GET /compute/v2.1/servers/20b5ce2d-dd53-4957-839f-b674794f29ee" status: 200 len: 1209 microversion: 2.1 time: 0.083595 Jul 21 10:58:19.741704 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 549/1108] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:58:19 2022] GET /compute/v2.1/servers/20b5ce2d-dd53-4957-839f-b674794f29ee => generated 1209 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:58:20.760826 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-142f777e-9fcd-4474-9a98-28fa5a29548b tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:58:20.761422 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-142f777e-9fcd-4474-9a98-28fa5a29548b tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] [instance: 20b5ce2d-dd53-4957-839f-b674794f29ee] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:58:20.767827 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-142f777e-9fcd-4474-9a98-28fa5a29548b tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:58:20.768644 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-142f777e-9fcd-4474-9a98-28fa5a29548b tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:58:20.769085 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-142f777e-9fcd-4474-9a98-28fa5a29548b tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:58:20.769713 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-142f777e-9fcd-4474-9a98-28fa5a29548b tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:58:20.942210 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-142f777e-9fcd-4474-9a98-28fa5a29548b tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0aebc4614c448bdb77fb167d4ae3de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99e5deac07a429c9c771ef41d278a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:58:20.950731 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-142f777e-9fcd-4474-9a98-28fa5a29548b tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] 10.222.0.48 "GET /compute/v2.1/servers/20b5ce2d-dd53-4957-839f-b674794f29ee" status: 200 len: 1276 microversion: 2.1 time: 0.193763 Jul 21 10:58:20.951562 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 560/1109] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:58:20 2022] GET /compute/v2.1/servers/20b5ce2d-dd53-4957-839f-b674794f29ee => generated 1276 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:58:21.100767 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [req-e0972ee0-ad89-4256-85a5-c84bcd4de3b6 req-287cfad2-cbd9-47db-b212-7a9ba9ac6594 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20b5ce2d-dd53-4957-839f-b674794f29ee", "tag": "297932c9-c2bf-4d0d-a5e4-14259e6cc191"}]} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:58:21.110820 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-e0972ee0-ad89-4256-85a5-c84bcd4de3b6 req-287cfad2-cbd9-47db-b212-7a9ba9ac6594 service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:58:21.120005 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-e0972ee0-ad89-4256-85a5-c84bcd4de3b6 req-287cfad2-cbd9-47db-b212-7a9ba9ac6594 service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:58:21.124882 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.compute.server_external_events [req-e0972ee0-ad89-4256-85a5-c84bcd4de3b6 req-287cfad2-cbd9-47db-b212-7a9ba9ac6594 service nova] Creating event network-changed:297932c9-c2bf-4d0d-a5e4-14259e6cc191 for instance 20b5ce2d-dd53-4957-839f-b674794f29ee on hv-cinder-84980 Jul 21 10:58:21.130087 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [req-e0972ee0-ad89-4256-85a5-c84bcd4de3b6 req-287cfad2-cbd9-47db-b212-7a9ba9ac6594 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032947 Jul 21 10:58:21.130784 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 550/1110] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 21 10:58:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:58:21.969002 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-cd0bbf1c-dde9-4232-823a-d71c9dea294b tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:58:21.969747 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-cd0bbf1c-dde9-4232-823a-d71c9dea294b tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] [instance: 20b5ce2d-dd53-4957-839f-b674794f29ee] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:58:21.976165 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-cd0bbf1c-dde9-4232-823a-d71c9dea294b tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:58:21.976613 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-cd0bbf1c-dde9-4232-823a-d71c9dea294b tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:58:21.978046 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-cd0bbf1c-dde9-4232-823a-d71c9dea294b tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:58:21.978513 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-cd0bbf1c-dde9-4232-823a-d71c9dea294b tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:58:22.115485 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-cd0bbf1c-dde9-4232-823a-d71c9dea294b tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0aebc4614c448bdb77fb167d4ae3de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99e5deac07a429c9c771ef41d278a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:58:22.123691 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-cd0bbf1c-dde9-4232-823a-d71c9dea294b tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] 10.222.0.48 "GET /compute/v2.1/servers/20b5ce2d-dd53-4957-839f-b674794f29ee" status: 200 len: 1264 microversion: 2.1 time: 0.158516 Jul 21 10:58:22.124261 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 561/1111] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:58:21 2022] GET /compute/v2.1/servers/20b5ce2d-dd53-4957-839f-b674794f29ee => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:58:23.140215 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-f4b8b84a-e1a4-441d-ba30-e59771d2b85f tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:58:23.140900 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-f4b8b84a-e1a4-441d-ba30-e59771d2b85f tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] [instance: 20b5ce2d-dd53-4957-839f-b674794f29ee] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:58:23.147704 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f4b8b84a-e1a4-441d-ba30-e59771d2b85f tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:58:23.148153 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f4b8b84a-e1a4-441d-ba30-e59771d2b85f tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:58:23.148911 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f4b8b84a-e1a4-441d-ba30-e59771d2b85f tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:58:23.150032 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f4b8b84a-e1a4-441d-ba30-e59771d2b85f tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:58:23.270071 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-aa7c8eb5-7981-47e9-a336-1cbe95a32cf5 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:58:23.270652 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-aa7c8eb5-7981-47e9-a336-1cbe95a32cf5 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] [instance: c655f0ec-4155-4f8c-8672-2014f6ea1316] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:58:23.277851 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-aa7c8eb5-7981-47e9-a336-1cbe95a32cf5 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:58:23.278300 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-aa7c8eb5-7981-47e9-a336-1cbe95a32cf5 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:58:23.279090 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-aa7c8eb5-7981-47e9-a336-1cbe95a32cf5 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:58:23.279523 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-aa7c8eb5-7981-47e9-a336-1cbe95a32cf5 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:58:23.284312 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-f4b8b84a-e1a4-441d-ba30-e59771d2b85f tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0aebc4614c448bdb77fb167d4ae3de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99e5deac07a429c9c771ef41d278a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:58:23.292697 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-f4b8b84a-e1a4-441d-ba30-e59771d2b85f tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] 10.222.0.48 "GET /compute/v2.1/servers/20b5ce2d-dd53-4957-839f-b674794f29ee" status: 200 len: 1264 microversion: 2.1 time: 0.156579 Jul 21 10:58:23.293637 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 551/1112] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:58:23 2022] GET /compute/v2.1/servers/20b5ce2d-dd53-4957-839f-b674794f29ee => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:58:23.303070 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-aa7c8eb5-7981-47e9-a336-1cbe95a32cf5 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] 10.222.0.48 "GET /compute/v2.1/servers/c655f0ec-4155-4f8c-8672-2014f6ea1316/ips" status: 200 len: 146 microversion: 2.1 time: 0.036736 Jul 21 10:58:23.303636 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 562/1113] 10.222.0.48 () {58 vars in 1247 bytes} [Thu Jul 21 10:58:23 2022] GET /compute/v2.1/servers/c655f0ec-4155-4f8c-8672-2014f6ea1316/ips => generated 146 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 10:58:24.309182 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-876ff660-fbf4-40a1-b7b2-20f2dbe5cc21 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:58:24.309724 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-876ff660-fbf4-40a1-b7b2-20f2dbe5cc21 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] [instance: 20b5ce2d-dd53-4957-839f-b674794f29ee] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:58:24.316044 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-876ff660-fbf4-40a1-b7b2-20f2dbe5cc21 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:58:24.316483 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-876ff660-fbf4-40a1-b7b2-20f2dbe5cc21 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:58:24.317233 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-876ff660-fbf4-40a1-b7b2-20f2dbe5cc21 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:58:24.317660 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-876ff660-fbf4-40a1-b7b2-20f2dbe5cc21 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:58:24.452195 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-876ff660-fbf4-40a1-b7b2-20f2dbe5cc21 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0aebc4614c448bdb77fb167d4ae3de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99e5deac07a429c9c771ef41d278a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:58:24.460113 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-876ff660-fbf4-40a1-b7b2-20f2dbe5cc21 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] 10.222.0.48 "GET /compute/v2.1/servers/20b5ce2d-dd53-4957-839f-b674794f29ee" status: 200 len: 1264 microversion: 2.1 time: 0.154823 Jul 21 10:58:24.460688 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 552/1114] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:58:24 2022] GET /compute/v2.1/servers/20b5ce2d-dd53-4957-839f-b674794f29ee => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:58:24.848478 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-48e087bd-29e3-438b-9c16-7f0cfc16b936 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "de06cd98-dd64-4f10-92d6-6196b79d9acf"}} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:58:24.849599 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-48e087bd-29e3-438b-9c16-7f0cfc16b936 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] [instance: c655f0ec-4155-4f8c-8672-2014f6ea1316] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:58:24.856136 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-48e087bd-29e3-438b-9c16-7f0cfc16b936 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:58:24.856585 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-48e087bd-29e3-438b-9c16-7f0cfc16b936 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:58:24.857350 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-48e087bd-29e3-438b-9c16-7f0cfc16b936 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:58:24.857790 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-48e087bd-29e3-438b-9c16-7f0cfc16b936 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:58:25.477132 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-fed9704b-6201-4c75-8d42-408d73fb3107 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:58:25.477972 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-fed9704b-6201-4c75-8d42-408d73fb3107 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] [instance: 20b5ce2d-dd53-4957-839f-b674794f29ee] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:58:25.484792 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-fed9704b-6201-4c75-8d42-408d73fb3107 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:58:25.485241 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-fed9704b-6201-4c75-8d42-408d73fb3107 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:58:25.485991 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-fed9704b-6201-4c75-8d42-408d73fb3107 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:58:25.486425 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-fed9704b-6201-4c75-8d42-408d73fb3107 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:58:25.544456 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-48e087bd-29e3-438b-9c16-7f0cfc16b936 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] 10.222.0.48 "POST /compute/v2.1/servers/c655f0ec-4155-4f8c-8672-2014f6ea1316/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.699635 Jul 21 10:58:25.545096 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 563/1115] 10.222.0.48 () {60 vars in 1322 bytes} [Thu Jul 21 10:58:24 2022] POST /compute/v2.1/servers/c655f0ec-4155-4f8c-8672-2014f6ea1316/os-volume_attachments => generated 194 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:58:25.628596 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-fed9704b-6201-4c75-8d42-408d73fb3107 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0aebc4614c448bdb77fb167d4ae3de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99e5deac07a429c9c771ef41d278a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:58:25.637058 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-fed9704b-6201-4c75-8d42-408d73fb3107 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] 10.222.0.48 "GET /compute/v2.1/servers/20b5ce2d-dd53-4957-839f-b674794f29ee" status: 200 len: 1264 microversion: 2.1 time: 0.163556 Jul 21 10:58:25.637527 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 553/1116] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:58:25 2022] GET /compute/v2.1/servers/20b5ce2d-dd53-4957-839f-b674794f29ee => generated 1264 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:58:26.655130 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-849713cf-2f17-409d-826e-0f390a0d2501 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:58:26.658181 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-849713cf-2f17-409d-826e-0f390a0d2501 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] [instance: 20b5ce2d-dd53-4957-839f-b674794f29ee] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:58:26.661910 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-849713cf-2f17-409d-826e-0f390a0d2501 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:58:26.662354 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-849713cf-2f17-409d-826e-0f390a0d2501 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:58:26.663130 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-849713cf-2f17-409d-826e-0f390a0d2501 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:58:26.663559 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-849713cf-2f17-409d-826e-0f390a0d2501 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:58:26.795806 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-849713cf-2f17-409d-826e-0f390a0d2501 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0aebc4614c448bdb77fb167d4ae3de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99e5deac07a429c9c771ef41d278a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:58:26.803359 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-849713cf-2f17-409d-826e-0f390a0d2501 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] 10.222.0.48 "GET /compute/v2.1/servers/20b5ce2d-dd53-4957-839f-b674794f29ee" status: 200 len: 1264 microversion: 2.1 time: 0.153634 Jul 21 10:58:26.803917 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 564/1117] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:58:26 2022] GET /compute/v2.1/servers/20b5ce2d-dd53-4957-839f-b674794f29ee => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:58:27.820948 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-136571b7-2460-451e-b04e-9472626f53c7 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:58:27.821557 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-136571b7-2460-451e-b04e-9472626f53c7 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] [instance: 20b5ce2d-dd53-4957-839f-b674794f29ee] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:58:27.824156 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell0:SELECT=2 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:58:27.828953 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-136571b7-2460-451e-b04e-9472626f53c7 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:58:27.829399 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-136571b7-2460-451e-b04e-9472626f53c7 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:58:27.830158 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-136571b7-2460-451e-b04e-9472626f53c7 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:58:27.830674 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-136571b7-2460-451e-b04e-9472626f53c7 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:58:27.963303 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-136571b7-2460-451e-b04e-9472626f53c7 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0aebc4614c448bdb77fb167d4ae3de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99e5deac07a429c9c771ef41d278a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:58:27.971549 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-136571b7-2460-451e-b04e-9472626f53c7 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] 10.222.0.48 "GET /compute/v2.1/servers/20b5ce2d-dd53-4957-839f-b674794f29ee" status: 200 len: 1264 microversion: 2.1 time: 0.154448 Jul 21 10:58:27.972116 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 554/1118] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:58:27 2022] GET /compute/v2.1/servers/20b5ce2d-dd53-4957-839f-b674794f29ee => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:58:28.988735 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-13707ae4-d641-45c4-8ebe-97cfaf640778 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:58:28.989343 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-13707ae4-d641-45c4-8ebe-97cfaf640778 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] [instance: 20b5ce2d-dd53-4957-839f-b674794f29ee] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:58:28.991295 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell0:SELECT=2 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:58:28.992100 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell0:SELECT=6 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:58:28.997895 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-13707ae4-d641-45c4-8ebe-97cfaf640778 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:58:28.998350 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-13707ae4-d641-45c4-8ebe-97cfaf640778 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:58:28.999142 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-13707ae4-d641-45c4-8ebe-97cfaf640778 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:58:28.999579 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-13707ae4-d641-45c4-8ebe-97cfaf640778 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:58:29.131778 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-13707ae4-d641-45c4-8ebe-97cfaf640778 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0aebc4614c448bdb77fb167d4ae3de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99e5deac07a429c9c771ef41d278a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:58:29.139911 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-13707ae4-d641-45c4-8ebe-97cfaf640778 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] 10.222.0.48 "GET /compute/v2.1/servers/20b5ce2d-dd53-4957-839f-b674794f29ee" status: 200 len: 1264 microversion: 2.1 time: 0.155041 Jul 21 10:58:29.140468 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 565/1119] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:58:28 2022] GET /compute/v2.1/servers/20b5ce2d-dd53-4957-839f-b674794f29ee => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:58:30.157238 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-1b1152bf-ed93-44c6-965a-3450f6dfa284 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:58:30.157843 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-1b1152bf-ed93-44c6-965a-3450f6dfa284 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] [instance: 20b5ce2d-dd53-4957-839f-b674794f29ee] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:58:30.164339 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1b1152bf-ed93-44c6-965a-3450f6dfa284 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:58:30.164792 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1b1152bf-ed93-44c6-965a-3450f6dfa284 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:58:30.165556 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1b1152bf-ed93-44c6-965a-3450f6dfa284 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:58:30.165990 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-1b1152bf-ed93-44c6-965a-3450f6dfa284 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:58:30.297057 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-1b1152bf-ed93-44c6-965a-3450f6dfa284 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0aebc4614c448bdb77fb167d4ae3de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99e5deac07a429c9c771ef41d278a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:58:30.304392 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-1b1152bf-ed93-44c6-965a-3450f6dfa284 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] 10.222.0.48 "GET /compute/v2.1/servers/20b5ce2d-dd53-4957-839f-b674794f29ee" status: 200 len: 1264 microversion: 2.1 time: 0.151011 Jul 21 10:58:30.304958 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 555/1120] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:58:30 2022] GET /compute/v2.1/servers/20b5ce2d-dd53-4957-839f-b674794f29ee => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:58:31.321819 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-030e340f-58e7-4672-b0bb-954d0e13ed3f tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:58:31.322405 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-030e340f-58e7-4672-b0bb-954d0e13ed3f tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] [instance: 20b5ce2d-dd53-4957-839f-b674794f29ee] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:58:31.329129 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-030e340f-58e7-4672-b0bb-954d0e13ed3f tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:58:31.329571 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-030e340f-58e7-4672-b0bb-954d0e13ed3f tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:58:31.330318 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-030e340f-58e7-4672-b0bb-954d0e13ed3f tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:58:31.330775 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-030e340f-58e7-4672-b0bb-954d0e13ed3f tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:58:31.467219 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-030e340f-58e7-4672-b0bb-954d0e13ed3f tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0aebc4614c448bdb77fb167d4ae3de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99e5deac07a429c9c771ef41d278a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:58:31.474583 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-030e340f-58e7-4672-b0bb-954d0e13ed3f tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] 10.222.0.48 "GET /compute/v2.1/servers/20b5ce2d-dd53-4957-839f-b674794f29ee" status: 200 len: 1264 microversion: 2.1 time: 0.156579 Jul 21 10:58:31.475140 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 566/1121] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:58:31 2022] GET /compute/v2.1/servers/20b5ce2d-dd53-4957-839f-b674794f29ee => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:58:32.168185 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [req-fc12f27d-a4de-4521-82d5-629c6ee988a1 req-a04b4bb4-b498-4243-8593-640dc98a47f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20b5ce2d-dd53-4957-839f-b674794f29ee", "name": "network-vif-plugged", "status": "completed", "tag": "297932c9-c2bf-4d0d-a5e4-14259e6cc191"}]} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:58:32.176691 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-fc12f27d-a4de-4521-82d5-629c6ee988a1 req-a04b4bb4-b498-4243-8593-640dc98a47f0 service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:58:32.177147 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-fc12f27d-a4de-4521-82d5-629c6ee988a1 req-a04b4bb4-b498-4243-8593-640dc98a47f0 service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:58:32.187857 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.compute.server_external_events [req-fc12f27d-a4de-4521-82d5-629c6ee988a1 req-a04b4bb4-b498-4243-8593-640dc98a47f0 service nova] Creating event network-vif-plugged:297932c9-c2bf-4d0d-a5e4-14259e6cc191 for instance 20b5ce2d-dd53-4957-839f-b674794f29ee on hv-cinder-84980 Jul 21 10:58:32.192855 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [req-fc12f27d-a4de-4521-82d5-629c6ee988a1 req-a04b4bb4-b498-4243-8593-640dc98a47f0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029794 Jul 21 10:58:32.193476 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 556/1122] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 21 10:58:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:58:32.491217 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-5d750525-80c2-4831-af49-2d0550e2d624 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:58:32.491864 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-5d750525-80c2-4831-af49-2d0550e2d624 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] [instance: 20b5ce2d-dd53-4957-839f-b674794f29ee] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:58:32.499052 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5d750525-80c2-4831-af49-2d0550e2d624 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:58:32.501156 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5d750525-80c2-4831-af49-2d0550e2d624 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:58:32.501156 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5d750525-80c2-4831-af49-2d0550e2d624 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:58:32.501156 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5d750525-80c2-4831-af49-2d0550e2d624 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:58:32.634520 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-5d750525-80c2-4831-af49-2d0550e2d624 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0aebc4614c448bdb77fb167d4ae3de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99e5deac07a429c9c771ef41d278a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:58:32.642769 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-5d750525-80c2-4831-af49-2d0550e2d624 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] 10.222.0.48 "GET /compute/v2.1/servers/20b5ce2d-dd53-4957-839f-b674794f29ee" status: 200 len: 1264 microversion: 2.1 time: 0.155360 Jul 21 10:58:32.643335 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 567/1123] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:58:32 2022] GET /compute/v2.1/servers/20b5ce2d-dd53-4957-839f-b674794f29ee => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:58:33.036449 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-4b5cc45a-1466-494a-8eef-3df4036e6bc7 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:58:33.037451 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-4b5cc45a-1466-494a-8eef-3df4036e6bc7 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] [instance: c655f0ec-4155-4f8c-8672-2014f6ea1316] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:58:33.043907 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4b5cc45a-1466-494a-8eef-3df4036e6bc7 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:58:33.044353 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4b5cc45a-1466-494a-8eef-3df4036e6bc7 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:58:33.045139 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4b5cc45a-1466-494a-8eef-3df4036e6bc7 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:58:33.045574 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4b5cc45a-1466-494a-8eef-3df4036e6bc7 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:58:33.075862 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-4b5cc45a-1466-494a-8eef-3df4036e6bc7 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] 10.222.0.48 "GET /compute/v2.1/servers/c655f0ec-4155-4f8c-8672-2014f6ea1316/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043704 Jul 21 10:58:33.076425 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 557/1124] 10.222.0.48 () {58 vars in 1301 bytes} [Thu Jul 21 10:58:33 2022] GET /compute/v2.1/servers/c655f0ec-4155-4f8c-8672-2014f6ea1316/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:58:33.086697 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-646d45e1-d7e9-4ced-9e8b-e1706719c0c5 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:58:33.087231 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-646d45e1-d7e9-4ced-9e8b-e1706719c0c5 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] [instance: c655f0ec-4155-4f8c-8672-2014f6ea1316] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:58:33.093322 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-646d45e1-d7e9-4ced-9e8b-e1706719c0c5 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:58:33.093774 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-646d45e1-d7e9-4ced-9e8b-e1706719c0c5 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:58:33.094530 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-646d45e1-d7e9-4ced-9e8b-e1706719c0c5 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:58:33.094995 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-646d45e1-d7e9-4ced-9e8b-e1706719c0c5 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:58:33.124377 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-646d45e1-d7e9-4ced-9e8b-e1706719c0c5 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] 10.222.0.48 "GET /compute/v2.1/servers/c655f0ec-4155-4f8c-8672-2014f6ea1316/os-volume_attachments/de06cd98-dd64-4f10-92d6-6196b79d9acf" status: 200 len: 194 microversion: 2.1 time: 0.041677 Jul 21 10:58:33.124946 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 568/1125] 10.222.0.48 () {58 vars in 1412 bytes} [Thu Jul 21 10:58:33 2022] GET /compute/v2.1/servers/c655f0ec-4155-4f8c-8672-2014f6ea1316/os-volume_attachments/de06cd98-dd64-4f10-92d6-6196b79d9acf => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:58:33.660087 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-d045a79c-e8b6-414f-90aa-506ddfa1c32d tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:58:33.660719 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-d045a79c-e8b6-414f-90aa-506ddfa1c32d tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] [instance: 20b5ce2d-dd53-4957-839f-b674794f29ee] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:58:33.668213 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d045a79c-e8b6-414f-90aa-506ddfa1c32d tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:58:33.668491 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d045a79c-e8b6-414f-90aa-506ddfa1c32d tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:58:33.669260 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d045a79c-e8b6-414f-90aa-506ddfa1c32d tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:58:33.669696 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d045a79c-e8b6-414f-90aa-506ddfa1c32d tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:58:33.810299 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-d045a79c-e8b6-414f-90aa-506ddfa1c32d tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0aebc4614c448bdb77fb167d4ae3de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99e5deac07a429c9c771ef41d278a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:58:33.817797 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-d045a79c-e8b6-414f-90aa-506ddfa1c32d tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] 10.222.0.48 "GET /compute/v2.1/servers/20b5ce2d-dd53-4957-839f-b674794f29ee" status: 200 len: 1264 microversion: 2.1 time: 0.161623 Jul 21 10:58:33.818802 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 558/1126] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:58:33 2022] GET /compute/v2.1/servers/20b5ce2d-dd53-4957-839f-b674794f29ee => generated 1264 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:58:34.680987 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-b2f7381a-d12e-40aa-80e9-a632d8f7fe5c tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "945fd423-3fef-42df-bddc-e34c2be64752"}} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:58:34.682044 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-b2f7381a-d12e-40aa-80e9-a632d8f7fe5c tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] [instance: c655f0ec-4155-4f8c-8672-2014f6ea1316] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:58:34.689200 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b2f7381a-d12e-40aa-80e9-a632d8f7fe5c tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:58:34.689650 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b2f7381a-d12e-40aa-80e9-a632d8f7fe5c tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:58:34.690412 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b2f7381a-d12e-40aa-80e9-a632d8f7fe5c tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:58:34.690878 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b2f7381a-d12e-40aa-80e9-a632d8f7fe5c tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:58:34.834873 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-9a25dbfa-4f03-4afc-94db-09fad0ef9cbf tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:58:34.835418 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-9a25dbfa-4f03-4afc-94db-09fad0ef9cbf tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] [instance: 20b5ce2d-dd53-4957-839f-b674794f29ee] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:58:34.841833 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9a25dbfa-4f03-4afc-94db-09fad0ef9cbf tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:58:34.842281 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9a25dbfa-4f03-4afc-94db-09fad0ef9cbf tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:58:34.843076 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9a25dbfa-4f03-4afc-94db-09fad0ef9cbf tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:58:34.843514 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9a25dbfa-4f03-4afc-94db-09fad0ef9cbf tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:58:34.979412 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-9a25dbfa-4f03-4afc-94db-09fad0ef9cbf tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0aebc4614c448bdb77fb167d4ae3de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99e5deac07a429c9c771ef41d278a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:58:34.987324 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-9a25dbfa-4f03-4afc-94db-09fad0ef9cbf tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] 10.222.0.48 "GET /compute/v2.1/servers/20b5ce2d-dd53-4957-839f-b674794f29ee" status: 200 len: 1451 microversion: 2.1 time: 0.156653 Jul 21 10:58:34.987900 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 559/1127] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:58:34 2022] GET /compute/v2.1/servers/20b5ce2d-dd53-4957-839f-b674794f29ee => generated 1451 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:58:35.003375 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-4e910aab-1cc4-4bf4-a1af-dd10f192b712 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:58:35.003981 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-4e910aab-1cc4-4bf4-a1af-dd10f192b712 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] [instance: 20b5ce2d-dd53-4957-839f-b674794f29ee] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:58:35.010140 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4e910aab-1cc4-4bf4-a1af-dd10f192b712 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:58:35.010628 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4e910aab-1cc4-4bf4-a1af-dd10f192b712 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:58:35.011489 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4e910aab-1cc4-4bf4-a1af-dd10f192b712 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:58:35.011949 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4e910aab-1cc4-4bf4-a1af-dd10f192b712 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:58:35.146043 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-4e910aab-1cc4-4bf4-a1af-dd10f192b712 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0aebc4614c448bdb77fb167d4ae3de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99e5deac07a429c9c771ef41d278a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:58:35.152278 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-4e910aab-1cc4-4bf4-a1af-dd10f192b712 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] 10.222.0.48 "GET /compute/v2.1/servers/20b5ce2d-dd53-4957-839f-b674794f29ee" status: 200 len: 1451 microversion: 2.1 time: 0.152549 Jul 21 10:58:35.152890 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 560/1128] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:58:34 2022] GET /compute/v2.1/servers/20b5ce2d-dd53-4957-839f-b674794f29ee => generated 1451 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 10:58:35.381186 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:58:35.457874 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-b2f7381a-d12e-40aa-80e9-a632d8f7fe5c tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] 10.222.0.48 "POST /compute/v2.1/servers/c655f0ec-4155-4f8c-8672-2014f6ea1316/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.780654 Jul 21 10:58:35.458726 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 569/1129] 10.222.0.48 () {60 vars in 1322 bytes} [Thu Jul 21 10:58:34 2022] POST /compute/v2.1/servers/c655f0ec-4155-4f8c-8672-2014f6ea1316/os-volume_attachments => generated 194 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 10:58:37.152566 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [req-f687aede-cc38-436e-914f-e42819eb1e51 req-c69ea307-fc0b-4312-84f5-d2ef697b15f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20b5ce2d-dd53-4957-839f-b674794f29ee", "tag": "297932c9-c2bf-4d0d-a5e4-14259e6cc191"}]} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:58:37.161145 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-f687aede-cc38-436e-914f-e42819eb1e51 req-c69ea307-fc0b-4312-84f5-d2ef697b15f4 service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:58:37.161873 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-f687aede-cc38-436e-914f-e42819eb1e51 req-c69ea307-fc0b-4312-84f5-d2ef697b15f4 service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:58:37.175379 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.compute.server_external_events [req-f687aede-cc38-436e-914f-e42819eb1e51 req-c69ea307-fc0b-4312-84f5-d2ef697b15f4 service nova] Creating event network-changed:297932c9-c2bf-4d0d-a5e4-14259e6cc191 for instance 20b5ce2d-dd53-4957-839f-b674794f29ee on hv-cinder-84980 Jul 21 10:58:37.180516 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [req-f687aede-cc38-436e-914f-e42819eb1e51 req-c69ea307-fc0b-4312-84f5-d2ef697b15f4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031546 Jul 21 10:58:37.181710 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 561/1130] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 21 10:58:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:58:42.960767 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-b75dbd39-943f-4067-8821-a7153433d39c tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:58:42.961823 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-b75dbd39-943f-4067-8821-a7153433d39c tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] [instance: c655f0ec-4155-4f8c-8672-2014f6ea1316] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:58:42.969339 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b75dbd39-943f-4067-8821-a7153433d39c tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:58:42.969724 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b75dbd39-943f-4067-8821-a7153433d39c tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:58:42.970498 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b75dbd39-943f-4067-8821-a7153433d39c tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:58:42.970977 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-b75dbd39-943f-4067-8821-a7153433d39c tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:58:43.001627 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-b75dbd39-943f-4067-8821-a7153433d39c tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] 10.222.0.48 "GET /compute/v2.1/servers/c655f0ec-4155-4f8c-8672-2014f6ea1316/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046658 Jul 21 10:58:43.002173 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 570/1131] 10.222.0.48 () {58 vars in 1301 bytes} [Thu Jul 21 10:58:42 2022] GET /compute/v2.1/servers/c655f0ec-4155-4f8c-8672-2014f6ea1316/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:58:43.139386 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-f131acf4-0152-48ed-8ce0-c866b5a91f2e tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:58:43.139985 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-f131acf4-0152-48ed-8ce0-c866b5a91f2e tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] [instance: c655f0ec-4155-4f8c-8672-2014f6ea1316] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:58:43.141912 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:58:43.146843 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f131acf4-0152-48ed-8ce0-c866b5a91f2e tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:58:43.147300 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f131acf4-0152-48ed-8ce0-c866b5a91f2e tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:58:43.148070 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f131acf4-0152-48ed-8ce0-c866b5a91f2e tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:58:43.148509 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f131acf4-0152-48ed-8ce0-c866b5a91f2e tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:58:43.152058 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:58:43.177660 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-f131acf4-0152-48ed-8ce0-c866b5a91f2e tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] 10.222.0.48 "GET /compute/v2.1/servers/c655f0ec-4155-4f8c-8672-2014f6ea1316/os-volume_attachments/de06cd98-dd64-4f10-92d6-6196b79d9acf" status: 200 len: 194 microversion: 2.1 time: 0.043773 Jul 21 10:58:43.178247 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 562/1132] 10.222.0.48 () {58 vars in 1412 bytes} [Thu Jul 21 10:58:43 2022] GET /compute/v2.1/servers/c655f0ec-4155-4f8c-8672-2014f6ea1316/os-volume_attachments/de06cd98-dd64-4f10-92d6-6196b79d9acf => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:58:43.188030 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-f3a79196-59f5-4cfb-b4cc-97952b4243a2 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:58:43.188527 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-f3a79196-59f5-4cfb-b4cc-97952b4243a2 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] [instance: c655f0ec-4155-4f8c-8672-2014f6ea1316] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:58:43.195035 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f3a79196-59f5-4cfb-b4cc-97952b4243a2 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:58:43.195481 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f3a79196-59f5-4cfb-b4cc-97952b4243a2 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:58:43.196252 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f3a79196-59f5-4cfb-b4cc-97952b4243a2 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:58:43.196688 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f3a79196-59f5-4cfb-b4cc-97952b4243a2 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:58:43.277487 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.objects.instance [None req-f3a79196-59f5-4cfb-b4cc-97952b4243a2 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lazy-loading 'services' on Instance uuid c655f0ec-4155-4f8c-8672-2014f6ea1316 {{(pid=124867) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 10:58:43.509908 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-f3a79196-59f5-4cfb-b4cc-97952b4243a2 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c655f0ec-4155-4f8c-8672-2014f6ea1316/os-volume_attachments/de06cd98-dd64-4f10-92d6-6196b79d9acf" status: 202 len: 0 microversion: 2.1 time: 0.325585 Jul 21 10:58:43.510368 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 571/1133] 10.222.0.48 () {58 vars in 1415 bytes} [Thu Jul 21 10:58:43 2022] DELETE /compute/v2.1/servers/c655f0ec-4155-4f8c-8672-2014f6ea1316/os-volume_attachments/de06cd98-dd64-4f10-92d6-6196b79d9acf => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 10:58:45.672525 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-274f402d-5c99-4c34-90bc-6f50f581bfb5 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:58:45.673034 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-274f402d-5c99-4c34-90bc-6f50f581bfb5 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] [instance: c655f0ec-4155-4f8c-8672-2014f6ea1316] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:58:45.679769 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-274f402d-5c99-4c34-90bc-6f50f581bfb5 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:58:45.680220 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-274f402d-5c99-4c34-90bc-6f50f581bfb5 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:58:45.687157 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-274f402d-5c99-4c34-90bc-6f50f581bfb5 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:58:45.687157 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-274f402d-5c99-4c34-90bc-6f50f581bfb5 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:58:45.711772 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-274f402d-5c99-4c34-90bc-6f50f581bfb5 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] 10.222.0.48 "GET /compute/v2.1/servers/c655f0ec-4155-4f8c-8672-2014f6ea1316/os-volume_attachments/945fd423-3fef-42df-bddc-e34c2be64752" status: 200 len: 194 microversion: 2.1 time: 0.044164 Jul 21 10:58:45.712353 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 563/1134] 10.222.0.48 () {58 vars in 1412 bytes} [Thu Jul 21 10:58:45 2022] GET /compute/v2.1/servers/c655f0ec-4155-4f8c-8672-2014f6ea1316/os-volume_attachments/945fd423-3fef-42df-bddc-e34c2be64752 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:58:45.723467 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-89dad421-0ebc-4921-954b-018fdb0e69aa tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:58:45.726583 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-89dad421-0ebc-4921-954b-018fdb0e69aa tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] [instance: c655f0ec-4155-4f8c-8672-2014f6ea1316] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:58:45.726583 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:58:45.730837 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-89dad421-0ebc-4921-954b-018fdb0e69aa tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:58:45.731285 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-89dad421-0ebc-4921-954b-018fdb0e69aa tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:58:45.732045 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-89dad421-0ebc-4921-954b-018fdb0e69aa tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:58:45.732478 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-89dad421-0ebc-4921-954b-018fdb0e69aa tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:58:45.813541 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.objects.instance [None req-89dad421-0ebc-4921-954b-018fdb0e69aa tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lazy-loading 'services' on Instance uuid c655f0ec-4155-4f8c-8672-2014f6ea1316 {{(pid=124867) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 10:58:46.018282 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-89dad421-0ebc-4921-954b-018fdb0e69aa tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c655f0ec-4155-4f8c-8672-2014f6ea1316/os-volume_attachments/945fd423-3fef-42df-bddc-e34c2be64752" status: 202 len: 0 microversion: 2.1 time: 0.299536 Jul 21 10:58:46.019136 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 572/1135] 10.222.0.48 () {58 vars in 1415 bytes} [Thu Jul 21 10:58:45 2022] DELETE /compute/v2.1/servers/c655f0ec-4155-4f8c-8672-2014f6ea1316/os-volume_attachments/945fd423-3fef-42df-bddc-e34c2be64752 => generated 0 bytes in 301 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 10:58:47.180213 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-a4ea3fe7-b3ad-4717-a3d4-ed9b047dcb18 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:58:47.181219 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-a4ea3fe7-b3ad-4717-a3d4-ed9b047dcb18 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] [instance: c655f0ec-4155-4f8c-8672-2014f6ea1316] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:58:47.187818 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a4ea3fe7-b3ad-4717-a3d4-ed9b047dcb18 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:58:47.192226 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a4ea3fe7-b3ad-4717-a3d4-ed9b047dcb18 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:58:47.192226 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a4ea3fe7-b3ad-4717-a3d4-ed9b047dcb18 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:58:47.192226 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a4ea3fe7-b3ad-4717-a3d4-ed9b047dcb18 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:58:47.219678 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-a4ea3fe7-b3ad-4717-a3d4-ed9b047dcb18 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] 10.222.0.48 "GET /compute/v2.1/servers/c655f0ec-4155-4f8c-8672-2014f6ea1316/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044616 Jul 21 10:58:47.220249 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 564/1136] 10.222.0.48 () {58 vars in 1301 bytes} [Thu Jul 21 10:58:47 2022] GET /compute/v2.1/servers/c655f0ec-4155-4f8c-8672-2014f6ea1316/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 21 10:58:47.324108 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-f4a985b0-eaf9-4d65-9530-e02cc5175af8 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:58:47.325114 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-f4a985b0-eaf9-4d65-9530-e02cc5175af8 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] [instance: c655f0ec-4155-4f8c-8672-2014f6ea1316] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:58:47.332260 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f4a985b0-eaf9-4d65-9530-e02cc5175af8 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:58:47.332702 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f4a985b0-eaf9-4d65-9530-e02cc5175af8 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:58:47.333453 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f4a985b0-eaf9-4d65-9530-e02cc5175af8 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:58:47.333887 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f4a985b0-eaf9-4d65-9530-e02cc5175af8 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:58:47.362315 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-f4a985b0-eaf9-4d65-9530-e02cc5175af8 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] 10.222.0.48 "GET /compute/v2.1/servers/c655f0ec-4155-4f8c-8672-2014f6ea1316/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042375 Jul 21 10:58:47.362899 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 573/1137] 10.222.0.48 () {58 vars in 1301 bytes} [Thu Jul 21 10:58:47 2022] GET /compute/v2.1/servers/c655f0ec-4155-4f8c-8672-2014f6ea1316/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 21 10:58:47.420790 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-ac1129e5-da1f-40d7-bb62-cf427bbc8263 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:58:47.421294 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-ac1129e5-da1f-40d7-bb62-cf427bbc8263 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] [instance: c655f0ec-4155-4f8c-8672-2014f6ea1316] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:58:47.428265 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ac1129e5-da1f-40d7-bb62-cf427bbc8263 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:58:47.428719 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ac1129e5-da1f-40d7-bb62-cf427bbc8263 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:58:47.429483 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ac1129e5-da1f-40d7-bb62-cf427bbc8263 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:58:47.429925 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ac1129e5-da1f-40d7-bb62-cf427bbc8263 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:58:47.455410 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-ac1129e5-da1f-40d7-bb62-cf427bbc8263 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] [instance: c655f0ec-4155-4f8c-8672-2014f6ea1316] Going to try to terminate instance {{(pid=124868) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 10:58:47.750150 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-ac1129e5-da1f-40d7-bb62-cf427bbc8263 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c655f0ec-4155-4f8c-8672-2014f6ea1316" status: 204 len: 0 microversion: 2.1 time: 0.333419 Jul 21 10:58:47.750780 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 565/1138] 10.222.0.48 () {58 vars in 1238 bytes} [Thu Jul 21 10:58:47 2022] DELETE /compute/v2.1/servers/c655f0ec-4155-4f8c-8672-2014f6ea1316 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 10:58:47.758843 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-63c317ca-dcb4-4729-b532-044dd0b5a63b tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:58:47.759574 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-63c317ca-dcb4-4729-b532-044dd0b5a63b tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] [instance: c655f0ec-4155-4f8c-8672-2014f6ea1316] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:58:47.765669 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-63c317ca-dcb4-4729-b532-044dd0b5a63b tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:58:47.766108 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-63c317ca-dcb4-4729-b532-044dd0b5a63b tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:58:47.766878 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-63c317ca-dcb4-4729-b532-044dd0b5a63b tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:58:47.767494 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-63c317ca-dcb4-4729-b532-044dd0b5a63b tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:58:47.899442 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-63c317ca-dcb4-4729-b532-044dd0b5a63b tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d76fa94b5ff4721bf490efd0699688e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3ae8ed116141658017f823c633c2f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:58:47.906794 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-63c317ca-dcb4-4729-b532-044dd0b5a63b tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] 10.222.0.48 "GET /compute/v2.1/servers/c655f0ec-4155-4f8c-8672-2014f6ea1316" status: 200 len: 1674 microversion: 2.1 time: 0.151695 Jul 21 10:58:47.907351 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 574/1139] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:58:47 2022] GET /compute/v2.1/servers/c655f0ec-4155-4f8c-8672-2014f6ea1316 => generated 1674 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:58:48.925238 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-4189e78a-46a3-4d25-abd6-004f3af1742e tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:58:48.925934 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-4189e78a-46a3-4d25-abd6-004f3af1742e tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] [instance: c655f0ec-4155-4f8c-8672-2014f6ea1316] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:58:48.932394 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4189e78a-46a3-4d25-abd6-004f3af1742e tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:58:48.932879 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4189e78a-46a3-4d25-abd6-004f3af1742e tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:58:48.933647 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4189e78a-46a3-4d25-abd6-004f3af1742e tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:58:48.934084 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4189e78a-46a3-4d25-abd6-004f3af1742e tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:58:49.067194 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-4189e78a-46a3-4d25-abd6-004f3af1742e tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d76fa94b5ff4721bf490efd0699688e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3ae8ed116141658017f823c633c2f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:58:49.074684 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-4189e78a-46a3-4d25-abd6-004f3af1742e tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] 10.222.0.48 "GET /compute/v2.1/servers/c655f0ec-4155-4f8c-8672-2014f6ea1316" status: 200 len: 1674 microversion: 2.1 time: 0.154190 Jul 21 10:58:49.075291 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 566/1140] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:58:48 2022] GET /compute/v2.1/servers/c655f0ec-4155-4f8c-8672-2014f6ea1316 => generated 1674 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:58:50.092631 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-1c78a632-c591-40c0-a775-a34d8f048167 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:58:50.093188 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-1c78a632-c591-40c0-a775-a34d8f048167 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] [instance: c655f0ec-4155-4f8c-8672-2014f6ea1316] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:58:50.099742 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1c78a632-c591-40c0-a775-a34d8f048167 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:58:50.100197 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1c78a632-c591-40c0-a775-a34d8f048167 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:58:50.100964 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1c78a632-c591-40c0-a775-a34d8f048167 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:58:50.101405 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-1c78a632-c591-40c0-a775-a34d8f048167 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:58:50.233235 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-1c78a632-c591-40c0-a775-a34d8f048167 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d76fa94b5ff4721bf490efd0699688e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3ae8ed116141658017f823c633c2f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:58:50.241217 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-1c78a632-c591-40c0-a775-a34d8f048167 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] 10.222.0.48 "GET /compute/v2.1/servers/c655f0ec-4155-4f8c-8672-2014f6ea1316" status: 200 len: 1674 microversion: 2.1 time: 0.152566 Jul 21 10:58:50.246822 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 575/1141] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:58:50 2022] GET /compute/v2.1/servers/c655f0ec-4155-4f8c-8672-2014f6ea1316 => generated 1674 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:58:50.695221 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [req-97e89d2b-e891-4a5e-9330-43ae5474473a req-b0c9aa69-1894-4b45-966c-0ef172e7bf72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c655f0ec-4155-4f8c-8672-2014f6ea1316", "name": "network-vif-deleted", "tag": "2155410f-78ee-46db-8356-a84ec028f65e"}]} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 10:58:50.703902 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-97e89d2b-e891-4a5e-9330-43ae5474473a req-b0c9aa69-1894-4b45-966c-0ef172e7bf72 service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:58:50.709242 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-97e89d2b-e891-4a5e-9330-43ae5474473a req-b0c9aa69-1894-4b45-966c-0ef172e7bf72 service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:58:50.715959 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.compute.server_external_events [req-97e89d2b-e891-4a5e-9330-43ae5474473a req-b0c9aa69-1894-4b45-966c-0ef172e7bf72 service nova] Creating event network-vif-deleted:2155410f-78ee-46db-8356-a84ec028f65e for instance c655f0ec-4155-4f8c-8672-2014f6ea1316 on hv-cinder-84980 Jul 21 10:58:50.721375 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [req-97e89d2b-e891-4a5e-9330-43ae5474473a req-b0c9aa69-1894-4b45-966c-0ef172e7bf72 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029820 Jul 21 10:58:50.722848 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 567/1142] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 21 10:58:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:58:51.262650 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-a1f2512d-a9ba-49bf-a06b-33d8cd1f0038 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:58:51.263272 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-a1f2512d-a9ba-49bf-a06b-33d8cd1f0038 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] [instance: c655f0ec-4155-4f8c-8672-2014f6ea1316] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:58:51.271100 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a1f2512d-a9ba-49bf-a06b-33d8cd1f0038 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:58:51.271557 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a1f2512d-a9ba-49bf-a06b-33d8cd1f0038 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:58:51.272346 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a1f2512d-a9ba-49bf-a06b-33d8cd1f0038 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:58:51.272785 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a1f2512d-a9ba-49bf-a06b-33d8cd1f0038 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:58:51.309735 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a1f2512d-a9ba-49bf-a06b-33d8cd1f0038 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:58:51.310182 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-a1f2512d-a9ba-49bf-a06b-33d8cd1f0038 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:58:51.310669 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.objects.instance [None req-a1f2512d-a9ba-49bf-a06b-33d8cd1f0038 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lazy-loading 'fault' on Instance uuid c655f0ec-4155-4f8c-8672-2014f6ea1316 {{(pid=124867) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 10:58:51.353858 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-a1f2512d-a9ba-49bf-a06b-33d8cd1f0038 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d76fa94b5ff4721bf490efd0699688e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3ae8ed116141658017f823c633c2f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 10:58:51.361778 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-a1f2512d-a9ba-49bf-a06b-33d8cd1f0038 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] 10.222.0.48 "GET /compute/v2.1/servers/c655f0ec-4155-4f8c-8672-2014f6ea1316" status: 200 len: 1327 microversion: 2.1 time: 0.102951 Jul 21 10:58:51.362369 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 576/1143] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:58:51 2022] GET /compute/v2.1/servers/c655f0ec-4155-4f8c-8672-2014f6ea1316 => generated 1327 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:58:52.380228 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-32bd9465-e5dd-4e84-96ac-5a90fc9d42f0 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:58:52.380831 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-32bd9465-e5dd-4e84-96ac-5a90fc9d42f0 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] [instance: c655f0ec-4155-4f8c-8672-2014f6ea1316] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:58:52.387043 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-32bd9465-e5dd-4e84-96ac-5a90fc9d42f0 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:58:52.387486 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-32bd9465-e5dd-4e84-96ac-5a90fc9d42f0 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:58:52.388237 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-32bd9465-e5dd-4e84-96ac-5a90fc9d42f0 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:58:52.388665 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-32bd9465-e5dd-4e84-96ac-5a90fc9d42f0 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:58:52.401986 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.wsgi [None req-32bd9465-e5dd-4e84-96ac-5a90fc9d42f0 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] HTTP exception thrown: Instance c655f0ec-4155-4f8c-8672-2014f6ea1316 could not be found. Jul 21 10:58:52.408128 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-32bd9465-e5dd-4e84-96ac-5a90fc9d42f0 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Request method failure captured: Jul 21 10:58:52.408128 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: request: GET /compute/v2.1/servers/c655f0ec-4155-4f8c-8672-2014f6ea1316 HTTP/1.1 Jul 21 10:58:52.408128 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Accept: application/json Jul 21 10:58:52.408128 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Accept-Encoding: identity Jul 21 10:58:52.408128 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Connection: close Jul 21 10:58:52.408128 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Content-Length: 0 Jul 21 10:58:52.408128 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Content-Type: application/json Jul 21 10:58:52.408128 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Host: 10.222.0.48 Jul 21 10:58:52.408128 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Openstack-System-Scope: None Jul 21 10:58:52.408128 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: User-Agent: python-urllib3/1.26.9 Jul 21 10:58:52.408128 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Auth-Token: gAAAAABi2TBnI5ZXFTuL-39INNZTI_QY7RIYH_Ky2pqCGymC2JyBDMNLdRcc7i6q2Vfz_Od8YaNaeLZ56DjYc6wD8wxJ8crQNVUQRMurDwwP8Bb7Ta6-lfMBRHWyuqkPfLJg_FiqJ6pd2A8mfmCkGT5cy1SyDecBHNUD-0LXOI9ggP4LUHv6_SY Jul 21 10:58:52.408128 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Domain-Id: None Jul 21 10:58:52.408128 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Domain-Name: None Jul 21 10:58:52.408128 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Identity-Status: Confirmed Jul 21 10:58:52.408128 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Is-Admin-Project: True Jul 21 10:58:52.408128 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Domain-Id: default Jul 21 10:58:52.408128 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Domain-Name: Default Jul 21 10:58:52.408128 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Id: ce3ae8ed116141658017f823c633c2f2 Jul 21 10:58:52.408128 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Name: tempest-AttachVolumeTestJSON-1108399766 Jul 21 10:58:52.408128 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Role: reader,member Jul 21 10:58:52.408128 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Roles: reader,member Jul 21 10:58:52.409930 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ce3ae8ed116141658017f823c633c2f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ce3ae8ed116141658017f823c633c2f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ce3ae8ed116141658017f823c633c2f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ce3ae8ed116141658017f823c633c2f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] Jul 21 10:58:52.409930 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Tenant: tempest-AttachVolumeTestJSON-1108399766 Jul 21 10:58:52.409930 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Tenant-Id: ce3ae8ed116141658017f823c633c2f2 Jul 21 10:58:52.409930 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1108399766 Jul 21 10:58:52.409930 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User: tempest-AttachVolumeTestJSON-1108399766-project Jul 21 10:58:52.409930 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Domain-Id: default Jul 21 10:58:52.409930 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Domain-Name: Default Jul 21 10:58:52.409930 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Id: 0d76fa94b5ff4721bf490efd0699688e Jul 21 10:58:52.409930 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Name: tempest-AttachVolumeTestJSON-1108399766-project Jul 21 10:58:52.409930 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: method: > Jul 21 10:58:52.409930 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: exception: Instance c655f0ec-4155-4f8c-8672-2014f6ea1316 could not be found. Jul 21 10:58:52.409930 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: action_args: {'id': 'c655f0ec-4155-4f8c-8672-2014f6ea1316'} Jul 21 10:58:52.411070 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 10:58:52.411070 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:58:52.411070 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 10:58:52.411070 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 10:58:52.411070 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 10:58:52.411070 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 10:58:52.411070 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 10:58:52.411070 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 10:58:52.411070 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 10:58:52.411070 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 10:58:52.411070 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c655f0ec-4155-4f8c-8672-2014f6ea1316 could not be found. Jul 21 10:58:52.411070 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:58:52.411070 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:58:52.411070 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:58:52.411070 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:58:52.411070 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:58:52.411070 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:58:52.411070 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 10:58:52.411070 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 10:58:52.411070 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 10:58:52.412685 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 10:58:52.412685 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 10:58:52.412685 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 10:58:52.412685 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 10:58:52.412685 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 10:58:52.412685 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 10:58:52.412685 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 10:58:52.412685 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c655f0ec-4155-4f8c-8672-2014f6ea1316 could not be found. Jul 21 10:58:52.412685 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:58:52.412685 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:58:52.412685 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:58:52.412685 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:58:52.412685 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:58:52.412685 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:58:52.412685 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 10:58:52.412685 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 10:58:52.412685 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c655f0ec-4155-4f8c-8672-2014f6ea1316 could not be found. Jul 21 10:58:52.412685 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:58:52.414720 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-32bd9465-e5dd-4e84-96ac-5a90fc9d42f0 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Returning 404 to user: Instance c655f0ec-4155-4f8c-8672-2014f6ea1316 could not be found. {{(pid=124868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 10:58:52.414720 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-32bd9465-e5dd-4e84-96ac-5a90fc9d42f0 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] 10.222.0.48 "GET /compute/v2.1/servers/c655f0ec-4155-4f8c-8672-2014f6ea1316" status: 404 len: 111 microversion: 2.1 time: 0.030024 Jul 21 10:58:52.414720 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 568/1144] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:58:52 2022] GET /compute/v2.1/servers/c655f0ec-4155-4f8c-8672-2014f6ea1316 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 10:58:52.417877 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-dd3993ab-daeb-414d-a98a-18bf4e2d042e tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Calling method '.version_select at 0x7f795e9a9550>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:58:52.528609 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-dd3993ab-daeb-414d-a98a-18bf4e2d042e tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1938726888" status: 202 len: 0 microversion: 2.1 time: 0.115638 Jul 21 10:58:52.529186 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 577/1145] 10.222.0.48 () {58 vars in 1220 bytes} [Thu Jul 21 10:58:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1938726888 => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 10:58:55.750042 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-b10147f3-6d0f-42e2-ba25-03a6626278b0 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:58:55.750566 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-b10147f3-6d0f-42e2-ba25-03a6626278b0 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] [instance: c655f0ec-4155-4f8c-8672-2014f6ea1316] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:58:55.757843 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b10147f3-6d0f-42e2-ba25-03a6626278b0 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:58:55.758294 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b10147f3-6d0f-42e2-ba25-03a6626278b0 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:58:55.759104 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b10147f3-6d0f-42e2-ba25-03a6626278b0 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:58:55.759546 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b10147f3-6d0f-42e2-ba25-03a6626278b0 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:58:55.774388 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.wsgi [None req-b10147f3-6d0f-42e2-ba25-03a6626278b0 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] HTTP exception thrown: Instance c655f0ec-4155-4f8c-8672-2014f6ea1316 could not be found. Jul 21 10:58:55.775982 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-b10147f3-6d0f-42e2-ba25-03a6626278b0 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Request method failure captured: Jul 21 10:58:55.775982 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: request: DELETE /compute/v2.1/servers/c655f0ec-4155-4f8c-8672-2014f6ea1316 HTTP/1.1 Jul 21 10:58:55.775982 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Accept: application/json Jul 21 10:58:55.775982 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Accept-Encoding: identity Jul 21 10:58:55.775982 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Connection: close Jul 21 10:58:55.775982 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Content-Length: 0 Jul 21 10:58:55.775982 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Content-Type: application/json Jul 21 10:58:55.775982 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Host: 10.222.0.48 Jul 21 10:58:55.775982 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Openstack-System-Scope: None Jul 21 10:58:55.775982 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: User-Agent: python-urllib3/1.26.9 Jul 21 10:58:55.775982 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Auth-Token: gAAAAABi2TBnI5ZXFTuL-39INNZTI_QY7RIYH_Ky2pqCGymC2JyBDMNLdRcc7i6q2Vfz_Od8YaNaeLZ56DjYc6wD8wxJ8crQNVUQRMurDwwP8Bb7Ta6-lfMBRHWyuqkPfLJg_FiqJ6pd2A8mfmCkGT5cy1SyDecBHNUD-0LXOI9ggP4LUHv6_SY Jul 21 10:58:55.775982 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Domain-Id: None Jul 21 10:58:55.775982 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Domain-Name: None Jul 21 10:58:55.775982 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Identity-Status: Confirmed Jul 21 10:58:55.775982 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Is-Admin-Project: True Jul 21 10:58:55.775982 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Domain-Id: default Jul 21 10:58:55.775982 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Domain-Name: Default Jul 21 10:58:55.775982 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Id: ce3ae8ed116141658017f823c633c2f2 Jul 21 10:58:55.775982 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Name: tempest-AttachVolumeTestJSON-1108399766 Jul 21 10:58:55.775982 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Role: reader,member Jul 21 10:58:55.775982 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Roles: reader,member Jul 21 10:58:55.778412 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ce3ae8ed116141658017f823c633c2f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ce3ae8ed116141658017f823c633c2f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ce3ae8ed116141658017f823c633c2f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ce3ae8ed116141658017f823c633c2f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] Jul 21 10:58:55.778412 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Tenant: tempest-AttachVolumeTestJSON-1108399766 Jul 21 10:58:55.778412 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Tenant-Id: ce3ae8ed116141658017f823c633c2f2 Jul 21 10:58:55.778412 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1108399766 Jul 21 10:58:55.778412 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User: tempest-AttachVolumeTestJSON-1108399766-project Jul 21 10:58:55.778412 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Domain-Id: default Jul 21 10:58:55.778412 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Domain-Name: Default Jul 21 10:58:55.778412 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Id: 0d76fa94b5ff4721bf490efd0699688e Jul 21 10:58:55.778412 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Name: tempest-AttachVolumeTestJSON-1108399766-project Jul 21 10:58:55.778412 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: method: > Jul 21 10:58:55.778412 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: exception: Instance c655f0ec-4155-4f8c-8672-2014f6ea1316 could not be found. Jul 21 10:58:55.778412 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: action_args: {'id': 'c655f0ec-4155-4f8c-8672-2014f6ea1316'} Jul 21 10:58:55.779584 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 10:58:55.779584 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:58:55.779584 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 10:58:55.779584 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 10:58:55.779584 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 10:58:55.779584 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 10:58:55.779584 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 10:58:55.779584 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 10:58:55.779584 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 10:58:55.779584 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 10:58:55.779584 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c655f0ec-4155-4f8c-8672-2014f6ea1316 could not be found. Jul 21 10:58:55.779584 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:58:55.779584 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:58:55.779584 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:58:55.779584 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:58:55.779584 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:58:55.779584 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:58:55.779584 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 10:58:55.779584 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 10:58:55.779584 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 10:58:55.780778 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 10:58:55.780778 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 21 10:58:55.780778 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 21 10:58:55.780778 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 21 10:58:55.780778 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 21 10:58:55.780778 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 10:58:55.780778 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 10:58:55.780778 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 10:58:55.780778 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 10:58:55.780778 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c655f0ec-4155-4f8c-8672-2014f6ea1316 could not be found. Jul 21 10:58:55.780778 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:58:55.780778 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:58:55.780778 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:58:55.780778 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:58:55.780778 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:58:55.780778 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:58:55.780778 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 10:58:55.780778 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 10:58:55.780778 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c655f0ec-4155-4f8c-8672-2014f6ea1316 could not be found. Jul 21 10:58:55.780778 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:58:55.782000 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-b10147f3-6d0f-42e2-ba25-03a6626278b0 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Returning 404 to user: Instance c655f0ec-4155-4f8c-8672-2014f6ea1316 could not be found. {{(pid=124868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 10:58:55.782000 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-b10147f3-6d0f-42e2-ba25-03a6626278b0 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c655f0ec-4155-4f8c-8672-2014f6ea1316" status: 404 len: 111 microversion: 2.1 time: 0.031212 Jul 21 10:58:55.782000 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 569/1146] 10.222.0.48 () {58 vars in 1238 bytes} [Thu Jul 21 10:58:55 2022] DELETE /compute/v2.1/servers/c655f0ec-4155-4f8c-8672-2014f6ea1316 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 10:58:55.786453 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-56117b42-81ae-40c5-967b-d1fc2716b589 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:58:55.787216 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-56117b42-81ae-40c5-967b-d1fc2716b589 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] [instance: c655f0ec-4155-4f8c-8672-2014f6ea1316] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:58:55.793728 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-56117b42-81ae-40c5-967b-d1fc2716b589 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:58:55.794181 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-56117b42-81ae-40c5-967b-d1fc2716b589 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:58:55.794997 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-56117b42-81ae-40c5-967b-d1fc2716b589 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:58:55.795433 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-56117b42-81ae-40c5-967b-d1fc2716b589 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:58:55.808975 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.wsgi [None req-56117b42-81ae-40c5-967b-d1fc2716b589 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] HTTP exception thrown: Instance c655f0ec-4155-4f8c-8672-2014f6ea1316 could not be found. Jul 21 10:58:55.810633 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-56117b42-81ae-40c5-967b-d1fc2716b589 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Request method failure captured: Jul 21 10:58:55.810633 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: request: GET /compute/v2.1/servers/c655f0ec-4155-4f8c-8672-2014f6ea1316 HTTP/1.1 Jul 21 10:58:55.810633 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Accept: application/json Jul 21 10:58:55.810633 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Accept-Encoding: identity Jul 21 10:58:55.810633 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Connection: close Jul 21 10:58:55.810633 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Content-Length: 0 Jul 21 10:58:55.810633 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Content-Type: application/json Jul 21 10:58:55.810633 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Host: 10.222.0.48 Jul 21 10:58:55.810633 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Openstack-System-Scope: None Jul 21 10:58:55.810633 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: User-Agent: python-urllib3/1.26.9 Jul 21 10:58:55.810633 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Auth-Token: gAAAAABi2TBnI5ZXFTuL-39INNZTI_QY7RIYH_Ky2pqCGymC2JyBDMNLdRcc7i6q2Vfz_Od8YaNaeLZ56DjYc6wD8wxJ8crQNVUQRMurDwwP8Bb7Ta6-lfMBRHWyuqkPfLJg_FiqJ6pd2A8mfmCkGT5cy1SyDecBHNUD-0LXOI9ggP4LUHv6_SY Jul 21 10:58:55.810633 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Domain-Id: None Jul 21 10:58:55.810633 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Domain-Name: None Jul 21 10:58:55.810633 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Identity-Status: Confirmed Jul 21 10:58:55.810633 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Is-Admin-Project: True Jul 21 10:58:55.810633 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Project-Domain-Id: default Jul 21 10:58:55.810633 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Project-Domain-Name: Default Jul 21 10:58:55.810633 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Project-Id: ce3ae8ed116141658017f823c633c2f2 Jul 21 10:58:55.810633 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Project-Name: tempest-AttachVolumeTestJSON-1108399766 Jul 21 10:58:55.810633 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Role: reader,member Jul 21 10:58:55.810633 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Roles: reader,member Jul 21 10:58:55.812245 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ce3ae8ed116141658017f823c633c2f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ce3ae8ed116141658017f823c633c2f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ce3ae8ed116141658017f823c633c2f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ce3ae8ed116141658017f823c633c2f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] Jul 21 10:58:55.812245 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Tenant: tempest-AttachVolumeTestJSON-1108399766 Jul 21 10:58:55.812245 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Tenant-Id: ce3ae8ed116141658017f823c633c2f2 Jul 21 10:58:55.812245 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1108399766 Jul 21 10:58:55.812245 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User: tempest-AttachVolumeTestJSON-1108399766-project Jul 21 10:58:55.812245 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User-Domain-Id: default Jul 21 10:58:55.812245 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User-Domain-Name: Default Jul 21 10:58:55.812245 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User-Id: 0d76fa94b5ff4721bf490efd0699688e Jul 21 10:58:55.812245 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User-Name: tempest-AttachVolumeTestJSON-1108399766-project Jul 21 10:58:55.812245 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: method: > Jul 21 10:58:55.812245 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: exception: Instance c655f0ec-4155-4f8c-8672-2014f6ea1316 could not be found. Jul 21 10:58:55.812245 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: action_args: {'id': 'c655f0ec-4155-4f8c-8672-2014f6ea1316'} Jul 21 10:58:55.813292 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 10:58:55.813292 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:58:55.813292 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 10:58:55.813292 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 10:58:55.813292 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 10:58:55.813292 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 10:58:55.813292 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 10:58:55.813292 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 10:58:55.813292 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 10:58:55.813292 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 10:58:55.813292 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c655f0ec-4155-4f8c-8672-2014f6ea1316 could not be found. Jul 21 10:58:55.813292 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:58:55.813292 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:58:55.813292 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:58:55.813292 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:58:55.813292 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:58:55.813292 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:58:55.813292 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 10:58:55.813292 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 10:58:55.813292 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 10:58:55.816214 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 10:58:55.816214 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 10:58:55.816214 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 10:58:55.816214 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 10:58:55.816214 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 10:58:55.816214 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 10:58:55.816214 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 10:58:55.816214 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c655f0ec-4155-4f8c-8672-2014f6ea1316 could not be found. Jul 21 10:58:55.816214 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:58:55.816214 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:58:55.816214 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:58:55.816214 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:58:55.816214 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:58:55.816214 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:58:55.816214 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 10:58:55.816214 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 10:58:55.816214 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c655f0ec-4155-4f8c-8672-2014f6ea1316 could not be found. Jul 21 10:58:55.816214 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:58:55.817688 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-56117b42-81ae-40c5-967b-d1fc2716b589 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Returning 404 to user: Instance c655f0ec-4155-4f8c-8672-2014f6ea1316 could not be found. {{(pid=124867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 10:58:55.817688 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-56117b42-81ae-40c5-967b-d1fc2716b589 tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] 10.222.0.48 "GET /compute/v2.1/servers/c655f0ec-4155-4f8c-8672-2014f6ea1316" status: 404 len: 111 microversion: 2.1 time: 0.030064 Jul 21 10:58:55.817688 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 578/1147] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:58:55 2022] GET /compute/v2.1/servers/c655f0ec-4155-4f8c-8672-2014f6ea1316 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 10:58:57.038956 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-b0ba6abc-0534-411b-8ae7-1541a660d90f tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:58:57.039446 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-b0ba6abc-0534-411b-8ae7-1541a660d90f tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] [instance: 5ec19443-8399-4f5f-b530-179ac8488e8a] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:58:57.045933 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b0ba6abc-0534-411b-8ae7-1541a660d90f tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:58:57.046512 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b0ba6abc-0534-411b-8ae7-1541a660d90f tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:58:57.047286 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b0ba6abc-0534-411b-8ae7-1541a660d90f tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:58:57.047717 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b0ba6abc-0534-411b-8ae7-1541a660d90f tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:58:57.061354 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.wsgi [None req-b0ba6abc-0534-411b-8ae7-1541a660d90f tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] HTTP exception thrown: Instance 5ec19443-8399-4f5f-b530-179ac8488e8a could not be found. Jul 21 10:58:57.062895 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-b0ba6abc-0534-411b-8ae7-1541a660d90f tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Request method failure captured: Jul 21 10:58:57.062895 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: request: DELETE /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a HTTP/1.1 Jul 21 10:58:57.062895 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Accept: application/json Jul 21 10:58:57.062895 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Accept-Encoding: identity Jul 21 10:58:57.062895 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Connection: close Jul 21 10:58:57.062895 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Content-Length: 0 Jul 21 10:58:57.062895 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Content-Type: application/json Jul 21 10:58:57.062895 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Host: 10.222.0.48 Jul 21 10:58:57.062895 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Openstack-System-Scope: None Jul 21 10:58:57.062895 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: User-Agent: python-urllib3/1.26.9 Jul 21 10:58:57.062895 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Auth-Token: gAAAAABi2TBnI5ZXFTuL-39INNZTI_QY7RIYH_Ky2pqCGymC2JyBDMNLdRcc7i6q2Vfz_Od8YaNaeLZ56DjYc6wD8wxJ8crQNVUQRMurDwwP8Bb7Ta6-lfMBRHWyuqkPfLJg_FiqJ6pd2A8mfmCkGT5cy1SyDecBHNUD-0LXOI9ggP4LUHv6_SY Jul 21 10:58:57.062895 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Domain-Id: None Jul 21 10:58:57.062895 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Domain-Name: None Jul 21 10:58:57.062895 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Identity-Status: Confirmed Jul 21 10:58:57.062895 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Is-Admin-Project: True Jul 21 10:58:57.062895 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Domain-Id: default Jul 21 10:58:57.062895 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Domain-Name: Default Jul 21 10:58:57.062895 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Id: ce3ae8ed116141658017f823c633c2f2 Jul 21 10:58:57.062895 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Name: tempest-AttachVolumeTestJSON-1108399766 Jul 21 10:58:57.062895 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Role: reader,member Jul 21 10:58:57.062895 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Roles: reader,member Jul 21 10:58:57.064548 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ce3ae8ed116141658017f823c633c2f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ce3ae8ed116141658017f823c633c2f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ce3ae8ed116141658017f823c633c2f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ce3ae8ed116141658017f823c633c2f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] Jul 21 10:58:57.064548 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Tenant: tempest-AttachVolumeTestJSON-1108399766 Jul 21 10:58:57.064548 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Tenant-Id: ce3ae8ed116141658017f823c633c2f2 Jul 21 10:58:57.064548 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1108399766 Jul 21 10:58:57.064548 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User: tempest-AttachVolumeTestJSON-1108399766-project Jul 21 10:58:57.064548 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Domain-Id: default Jul 21 10:58:57.064548 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Domain-Name: Default Jul 21 10:58:57.064548 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Id: 0d76fa94b5ff4721bf490efd0699688e Jul 21 10:58:57.064548 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Name: tempest-AttachVolumeTestJSON-1108399766-project Jul 21 10:58:57.064548 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: method: > Jul 21 10:58:57.064548 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: exception: Instance 5ec19443-8399-4f5f-b530-179ac8488e8a could not be found. Jul 21 10:58:57.064548 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: action_args: {'id': '5ec19443-8399-4f5f-b530-179ac8488e8a'} Jul 21 10:58:57.065476 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 10:58:57.065476 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:58:57.065476 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 10:58:57.065476 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 10:58:57.065476 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 10:58:57.065476 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 10:58:57.065476 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 10:58:57.065476 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 10:58:57.065476 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 10:58:57.065476 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 10:58:57.065476 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ec19443-8399-4f5f-b530-179ac8488e8a could not be found. Jul 21 10:58:57.065476 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:58:57.065476 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:58:57.065476 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:58:57.065476 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:58:57.065476 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:58:57.065476 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:58:57.065476 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 10:58:57.065476 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 10:58:57.065476 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 10:58:57.066852 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 10:58:57.066852 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 21 10:58:57.066852 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 21 10:58:57.066852 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 21 10:58:57.066852 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 21 10:58:57.066852 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 10:58:57.066852 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 10:58:57.066852 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 10:58:57.066852 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 10:58:57.066852 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ec19443-8399-4f5f-b530-179ac8488e8a could not be found. Jul 21 10:58:57.066852 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:58:57.066852 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:58:57.066852 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:58:57.066852 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:58:57.066852 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:58:57.066852 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:58:57.066852 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 10:58:57.066852 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 10:58:57.066852 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ec19443-8399-4f5f-b530-179ac8488e8a could not be found. Jul 21 10:58:57.066852 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 10:58:57.068090 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-b0ba6abc-0534-411b-8ae7-1541a660d90f tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Returning 404 to user: Instance 5ec19443-8399-4f5f-b530-179ac8488e8a could not be found. {{(pid=124868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 10:58:57.068090 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-b0ba6abc-0534-411b-8ae7-1541a660d90f tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] 10.222.0.48 "DELETE /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a" status: 404 len: 111 microversion: 2.1 time: 0.029087 Jul 21 10:58:57.068090 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 570/1148] 10.222.0.48 () {58 vars in 1238 bytes} [Thu Jul 21 10:58:57 2022] DELETE /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 21 10:58:57.072986 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-73650094-4312-45d3-bd87-955668fc99db tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:58:57.073600 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-73650094-4312-45d3-bd87-955668fc99db tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] [instance: 5ec19443-8399-4f5f-b530-179ac8488e8a] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 10:58:57.080873 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-73650094-4312-45d3-bd87-955668fc99db tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:58:57.081574 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-73650094-4312-45d3-bd87-955668fc99db tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:58:57.082322 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-73650094-4312-45d3-bd87-955668fc99db tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 10:58:57.082926 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-73650094-4312-45d3-bd87-955668fc99db tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 10:58:57.097638 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.wsgi [None req-73650094-4312-45d3-bd87-955668fc99db tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] HTTP exception thrown: Instance 5ec19443-8399-4f5f-b530-179ac8488e8a could not be found. Jul 21 10:58:57.099169 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-73650094-4312-45d3-bd87-955668fc99db tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Request method failure captured: Jul 21 10:58:57.099169 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: request: GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a HTTP/1.1 Jul 21 10:58:57.099169 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Accept: application/json Jul 21 10:58:57.099169 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Accept-Encoding: identity Jul 21 10:58:57.099169 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Connection: close Jul 21 10:58:57.099169 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Content-Length: 0 Jul 21 10:58:57.099169 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Content-Type: application/json Jul 21 10:58:57.099169 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Host: 10.222.0.48 Jul 21 10:58:57.099169 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Openstack-System-Scope: None Jul 21 10:58:57.099169 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: User-Agent: python-urllib3/1.26.9 Jul 21 10:58:57.099169 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Auth-Token: gAAAAABi2TBnI5ZXFTuL-39INNZTI_QY7RIYH_Ky2pqCGymC2JyBDMNLdRcc7i6q2Vfz_Od8YaNaeLZ56DjYc6wD8wxJ8crQNVUQRMurDwwP8Bb7Ta6-lfMBRHWyuqkPfLJg_FiqJ6pd2A8mfmCkGT5cy1SyDecBHNUD-0LXOI9ggP4LUHv6_SY Jul 21 10:58:57.099169 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Domain-Id: None Jul 21 10:58:57.099169 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Domain-Name: None Jul 21 10:58:57.099169 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Identity-Status: Confirmed Jul 21 10:58:57.099169 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Is-Admin-Project: True Jul 21 10:58:57.099169 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Project-Domain-Id: default Jul 21 10:58:57.099169 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Project-Domain-Name: Default Jul 21 10:58:57.099169 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Project-Id: ce3ae8ed116141658017f823c633c2f2 Jul 21 10:58:57.099169 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Project-Name: tempest-AttachVolumeTestJSON-1108399766 Jul 21 10:58:57.099169 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Role: reader,member Jul 21 10:58:57.099169 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Roles: reader,member Jul 21 10:58:57.100634 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ce3ae8ed116141658017f823c633c2f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ce3ae8ed116141658017f823c633c2f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ce3ae8ed116141658017f823c633c2f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ce3ae8ed116141658017f823c633c2f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] Jul 21 10:58:57.100634 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Tenant: tempest-AttachVolumeTestJSON-1108399766 Jul 21 10:58:57.100634 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Tenant-Id: ce3ae8ed116141658017f823c633c2f2 Jul 21 10:58:57.100634 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1108399766 Jul 21 10:58:57.100634 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User: tempest-AttachVolumeTestJSON-1108399766-project Jul 21 10:58:57.100634 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User-Domain-Id: default Jul 21 10:58:57.100634 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User-Domain-Name: Default Jul 21 10:58:57.100634 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User-Id: 0d76fa94b5ff4721bf490efd0699688e Jul 21 10:58:57.100634 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User-Name: tempest-AttachVolumeTestJSON-1108399766-project Jul 21 10:58:57.100634 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: method: > Jul 21 10:58:57.100634 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: exception: Instance 5ec19443-8399-4f5f-b530-179ac8488e8a could not be found. Jul 21 10:58:57.100634 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: action_args: {'id': '5ec19443-8399-4f5f-b530-179ac8488e8a'} Jul 21 10:58:57.101390 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 10:58:57.101390 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:58:57.101390 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 10:58:57.101390 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 10:58:57.101390 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 10:58:57.101390 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 10:58:57.101390 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 10:58:57.101390 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 10:58:57.101390 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 10:58:57.101390 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 10:58:57.101390 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ec19443-8399-4f5f-b530-179ac8488e8a could not be found. Jul 21 10:58:57.101390 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:58:57.101390 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:58:57.101390 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:58:57.101390 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:58:57.101390 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:58:57.101390 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:58:57.101390 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 10:58:57.101390 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 10:58:57.101390 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 10:58:57.102836 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 10:58:57.102836 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 10:58:57.102836 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 10:58:57.102836 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 10:58:57.102836 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 10:58:57.102836 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 10:58:57.102836 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 10:58:57.102836 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ec19443-8399-4f5f-b530-179ac8488e8a could not be found. Jul 21 10:58:57.102836 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:58:57.102836 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 10:58:57.102836 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:58:57.102836 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 10:58:57.102836 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 10:58:57.102836 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 10:58:57.102836 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 10:58:57.102836 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 10:58:57.102836 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ec19443-8399-4f5f-b530-179ac8488e8a could not be found. Jul 21 10:58:57.102836 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 10:58:57.104171 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-73650094-4312-45d3-bd87-955668fc99db tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] Returning 404 to user: Instance 5ec19443-8399-4f5f-b530-179ac8488e8a could not be found. {{(pid=124867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 10:58:57.104171 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-73650094-4312-45d3-bd87-955668fc99db tempest-AttachVolumeTestJSON-1108399766 tempest-AttachVolumeTestJSON-1108399766-project] 10.222.0.48 "GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a" status: 404 len: 111 microversion: 2.1 time: 0.031409 Jul 21 10:58:57.104171 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 579/1149] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 10:58:57 2022] GET /compute/v2.1/servers/5ec19443-8399-4f5f-b530-179ac8488e8a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 10:59:04.055624 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-75910c68-1734-4967-98a1-a2628f7ac34d tempest-VolumesTestJSON-1906027631 tempest-VolumesTestJSON-1906027631-project] Calling method '.version_select at 0x7f796343d310>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:59:04.103276 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-75910c68-1734-4967-98a1-a2628f7ac34d tempest-VolumesTestJSON-1906027631 tempest-VolumesTestJSON-1906027631-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/43c715fa-aea3-4f21-85a4-f06cabf4923f" status: 200 len: 351 microversion: 2.1 time: 0.051370 Jul 21 10:59:04.103840 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 571/1150] 10.222.0.48 () {58 vars in 1244 bytes} [Thu Jul 21 10:59:04 2022] GET /compute/v2.1/os-volumes/43c715fa-aea3-4f21-85a4-f06cabf4923f => generated 351 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:59:05.739337 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-6605141b-7b37-4eb0-9aee-b0b69854eb1e tempest-VolumesTestJSON-1906027631 tempest-VolumesTestJSON-1906027631-project] Calling method '.version_select at 0x7f795e9850d0>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:59:05.788273 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-6605141b-7b37-4eb0-9aee-b0b69854eb1e tempest-VolumesTestJSON-1906027631 tempest-VolumesTestJSON-1906027631-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/0c4313cc-f6c3-4e1d-b5e2-c6d9cd36c480" status: 200 len: 351 microversion: 2.1 time: 0.051044 Jul 21 10:59:05.788273 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 580/1151] 10.222.0.48 () {58 vars in 1244 bytes} [Thu Jul 21 10:59:05 2022] GET /compute/v2.1/os-volumes/0c4313cc-f6c3-4e1d-b5e2-c6d9cd36c480 => generated 351 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:59:07.325321 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:59:07.326094 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:59:07.329839 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-0da2cb14-edc4-4891-9720-0ef4eb781bd7 tempest-VolumesTestJSON-1906027631 tempest-VolumesTestJSON-1906027631-project] Calling method '.version_select at 0x7f79636b1dc0>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:59:07.376379 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-0da2cb14-edc4-4891-9720-0ef4eb781bd7 tempest-VolumesTestJSON-1906027631 tempest-VolumesTestJSON-1906027631-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/bcd4bd84-9ebd-40b4-bf8b-b7bdcd5b269e" status: 200 len: 351 microversion: 2.1 time: 0.052350 Jul 21 10:59:07.377011 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 572/1152] 10.222.0.48 () {58 vars in 1244 bytes} [Thu Jul 21 10:59:07 2022] GET /compute/v2.1/os-volumes/bcd4bd84-9ebd-40b4-bf8b-b7bdcd5b269e => generated 351 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:59:07.385339 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_api:SELECT=18,nova_api:DELETE=1 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:59:07.386070 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell1:SELECT=54,nova_cell1:INSERT=2 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 10:59:07.389841 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-9c1796c2-f4a8-4f0c-a0df-4271a09e2aaa tempest-VolumesTestJSON-1906027631 tempest-VolumesTestJSON-1906027631-project] Calling method '.version_select at 0x7f795e9a9700>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:59:07.472892 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-9c1796c2-f4a8-4f0c-a0df-4271a09e2aaa tempest-VolumesTestJSON-1906027631 tempest-VolumesTestJSON-1906027631-project] 10.222.0.48 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.088688 Jul 21 10:59:07.473475 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 581/1153] 10.222.0.48 () {58 vars in 1133 bytes} [Thu Jul 21 10:59:07 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:59:07.485953 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-aa1b46b1-34fb-45b6-a709-941a48747f84 tempest-VolumesTestJSON-1906027631 tempest-VolumesTestJSON-1906027631-project] Calling method '.version_select at 0x7f79634129d0>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:59:07.570964 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-aa1b46b1-34fb-45b6-a709-941a48747f84 tempest-VolumesTestJSON-1906027631 tempest-VolumesTestJSON-1906027631-project] 10.222.0.48 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.089247 Jul 21 10:59:07.571547 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 573/1154] 10.222.0.48 () {58 vars in 1148 bytes} [Thu Jul 21 10:59:07 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:59:07.583723 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-e6f800d5-ebb7-4e6b-90e4-a73c14bbdcf4 tempest-VolumesTestJSON-1906027631 tempest-VolumesTestJSON-1906027631-project] Calling method '.version_select at 0x7f7964012b80>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:59:07.664553 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-e6f800d5-ebb7-4e6b-90e4-a73c14bbdcf4 tempest-VolumesTestJSON-1906027631 tempest-VolumesTestJSON-1906027631-project] 10.222.0.48 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.085095 Jul 21 10:59:07.665148 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 582/1155] 10.222.0.48 () {58 vars in 1133 bytes} [Thu Jul 21 10:59:07 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:59:07.676100 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-e56d23ab-aad6-4620-9d59-f06e99ff649a tempest-VolumesTestJSON-1906027631 tempest-VolumesTestJSON-1906027631-project] Calling method '.version_select at 0x7f79636b1ee0>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:59:07.755688 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-e56d23ab-aad6-4620-9d59-f06e99ff649a tempest-VolumesTestJSON-1906027631 tempest-VolumesTestJSON-1906027631-project] 10.222.0.48 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.083288 Jul 21 10:59:07.756257 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 574/1156] 10.222.0.48 () {58 vars in 1166 bytes} [Thu Jul 21 10:59:07 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:59:07.767496 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-9f5a6f74-6dd2-482a-99fb-852e34984ccf tempest-VolumesTestJSON-1906027631 tempest-VolumesTestJSON-1906027631-project] Calling method '.version_select at 0x7f795e9855e0>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:59:07.846945 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-9f5a6f74-6dd2-482a-99fb-852e34984ccf tempest-VolumesTestJSON-1906027631 tempest-VolumesTestJSON-1906027631-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.082414 Jul 21 10:59:07.847560 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 583/1157] 10.222.0.48 () {58 vars in 1169 bytes} [Thu Jul 21 10:59:07 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:59:07.859129 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-b92b6469-d7ed-40d9-a754-b7dbf65519f1 tempest-VolumesTestJSON-1906027631 tempest-VolumesTestJSON-1906027631-project] Calling method '.version_select at 0x7f7963654310>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:59:07.937616 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-b92b6469-d7ed-40d9-a754-b7dbf65519f1 tempest-VolumesTestJSON-1906027631 tempest-VolumesTestJSON-1906027631-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.082089 Jul 21 10:59:07.938182 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 575/1158] 10.222.0.48 () {58 vars in 1154 bytes} [Thu Jul 21 10:59:07 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:59:07.949549 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-08fe52bb-9e28-4e02-a037-721e41d98359 tempest-VolumesTestJSON-1906027631 tempest-VolumesTestJSON-1906027631-project] Calling method '.version_select at 0x7f795ea6b4c0>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:59:08.029315 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-08fe52bb-9e28-4e02-a037-721e41d98359 tempest-VolumesTestJSON-1906027631 tempest-VolumesTestJSON-1906027631-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.083360 Jul 21 10:59:08.029903 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 584/1159] 10.222.0.48 () {58 vars in 1187 bytes} [Thu Jul 21 10:59:07 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 10:59:08.041590 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-db7e0fa8-4c20-40aa-9780-34308c9eec0c tempest-VolumesTestJSON-1906027631 tempest-VolumesTestJSON-1906027631-project] Calling method '.version_select at 0x7f7963412160>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 10:59:08.120598 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-db7e0fa8-4c20-40aa-9780-34308c9eec0c tempest-VolumesTestJSON-1906027631 tempest-VolumesTestJSON-1906027631-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.082568 Jul 21 10:59:08.121170 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 576/1160] 10.222.0.48 () {58 vars in 1154 bytes} [Thu Jul 21 10:59:08 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 10:59:52.526530 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 10:59:52.527207 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Thu Jul 21 10:59:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 11:00:02.047678 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-4f816347-27b8-4e21-9b63-7f6895735f0b tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1552236515", "imageRef": "282ddb30-fa0f-489d-9cc3-a3e70e03c631", "flavorRef": "452"}} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 11:00:02.097713 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.network.neutron [None req-4f816347-27b8-4e21-9b63-7f6895735f0b tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] validate_networks() for None {{(pid=124867) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 11:00:02.364096 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-4f816347-27b8-4e21-9b63-7f6895735f0b tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] Flavor limits 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 11:00:02.364512 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-4f816347-27b8-4e21-9b63-7f6895735f0b tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] Image limits 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 11:00:02.364974 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-4f816347-27b8-4e21-9b63-7f6895735f0b tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] Flavor pref 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 11:00:02.365377 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-4f816347-27b8-4e21-9b63-7f6895735f0b tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] Image pref 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 11:00:02.365779 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-4f816347-27b8-4e21-9b63-7f6895735f0b tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 11:00:02.375924 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-4f816347-27b8-4e21-9b63-7f6895735f0b tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 11:00:02.376365 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-4f816347-27b8-4e21-9b63-7f6895735f0b tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 11:00:02.377143 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-4f816347-27b8-4e21-9b63-7f6895735f0b tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 11:00:02.377572 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-4f816347-27b8-4e21-9b63-7f6895735f0b tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 11:00:02.394861 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.quota [None req-4f816347-27b8-4e21-9b63-7f6895735f0b tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] Getting quotas for project 400e7fad8c43490d8510d77e6c10ce87. Resources: {'ram', 'instances', 'cores'} {{(pid=124867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 11:00:02.398700 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.quota [None req-4f816347-27b8-4e21-9b63-7f6895735f0b tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] Getting quotas for user d2f0ca4d2e5d4157a3e595e0787c0b93 and project 400e7fad8c43490d8510d77e6c10ce87. Resources: {'ram', 'instances', 'cores'} {{(pid=124867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 11:00:02.409849 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-4f816347-27b8-4e21-9b63-7f6895735f0b tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] Going to run 1 instances... {{(pid=124867) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 11:00:02.412070 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-4f816347-27b8-4e21-9b63-7f6895735f0b tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] [instance: 5d0fbaed-f809-449d-849c-d943e2abf8bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='282ddb30-fa0f-489d-9cc3-a3e70e03c631',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124867) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 11:00:02.577602 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-4f816347-27b8-4e21-9b63-7f6895735f0b tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.534675 Jul 21 11:00:02.578416 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 585/1161] 10.222.0.48 () {60 vars in 1146 bytes} [Thu Jul 21 11:00:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 536 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 11:00:02.589675 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-7c271653-830e-4aec-962a-09a1609305ef tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 11:00:02.590277 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-7c271653-830e-4aec-962a-09a1609305ef tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] [instance: 5d0fbaed-f809-449d-849c-d943e2abf8bc] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 11:00:02.642744 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-7c271653-830e-4aec-962a-09a1609305ef tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f0ca4d2e5d4157a3e595e0787c0b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400e7fad8c43490d8510d77e6c10ce87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 11:00:02.649970 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-7c271653-830e-4aec-962a-09a1609305ef tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] 10.222.0.48 "GET /compute/v2.1/servers/5d0fbaed-f809-449d-849c-d943e2abf8bc" status: 200 len: 1215 microversion: 2.1 time: 0.065202 Jul 21 11:00:02.650842 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 577/1162] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 11:00:02 2022] GET /compute/v2.1/servers/5d0fbaed-f809-449d-849c-d943e2abf8bc => generated 1215 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 11:00:03.668534 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-5ad5bdab-4db5-4451-acf6-572982efff5b tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 11:00:03.669139 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-5ad5bdab-4db5-4451-acf6-572982efff5b tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] [instance: 5d0fbaed-f809-449d-849c-d943e2abf8bc] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 11:00:03.676082 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5ad5bdab-4db5-4451-acf6-572982efff5b tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 11:00:03.676532 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5ad5bdab-4db5-4451-acf6-572982efff5b tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 11:00:03.677303 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5ad5bdab-4db5-4451-acf6-572982efff5b tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 11:00:03.677744 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5ad5bdab-4db5-4451-acf6-572982efff5b tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 11:00:03.738768 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-5ad5bdab-4db5-4451-acf6-572982efff5b tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f0ca4d2e5d4157a3e595e0787c0b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400e7fad8c43490d8510d77e6c10ce87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 11:00:03.746880 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-5ad5bdab-4db5-4451-acf6-572982efff5b tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] 10.222.0.48 "GET /compute/v2.1/servers/5d0fbaed-f809-449d-849c-d943e2abf8bc" status: 200 len: 1219 microversion: 2.1 time: 0.083534 Jul 21 11:00:03.747451 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 586/1163] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 11:00:03 2022] GET /compute/v2.1/servers/5d0fbaed-f809-449d-849c-d943e2abf8bc => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 11:00:04.764155 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-be9df482-d4d4-4c48-9f95-cc185bfd5a63 tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 11:00:04.764816 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-be9df482-d4d4-4c48-9f95-cc185bfd5a63 tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] [instance: 5d0fbaed-f809-449d-849c-d943e2abf8bc] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 11:00:04.771219 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-be9df482-d4d4-4c48-9f95-cc185bfd5a63 tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 11:00:04.771663 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-be9df482-d4d4-4c48-9f95-cc185bfd5a63 tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 11:00:04.772446 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-be9df482-d4d4-4c48-9f95-cc185bfd5a63 tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 11:00:04.772877 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-be9df482-d4d4-4c48-9f95-cc185bfd5a63 tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 11:00:04.839594 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-be9df482-d4d4-4c48-9f95-cc185bfd5a63 tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f0ca4d2e5d4157a3e595e0787c0b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400e7fad8c43490d8510d77e6c10ce87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 11:00:04.847303 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-be9df482-d4d4-4c48-9f95-cc185bfd5a63 tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] 10.222.0.48 "GET /compute/v2.1/servers/5d0fbaed-f809-449d-849c-d943e2abf8bc" status: 200 len: 1267 microversion: 2.1 time: 0.087273 Jul 21 11:00:04.854706 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 578/1164] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 11:00:04 2022] GET /compute/v2.1/servers/5d0fbaed-f809-449d-849c-d943e2abf8bc => generated 1267 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 11:00:05.865084 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-5dffdc47-fbbc-4cec-a5f3-ce2839feb14a tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 11:00:05.865676 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-5dffdc47-fbbc-4cec-a5f3-ce2839feb14a tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] [instance: 5d0fbaed-f809-449d-849c-d943e2abf8bc] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 11:00:05.872827 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5dffdc47-fbbc-4cec-a5f3-ce2839feb14a tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 11:00:05.873271 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5dffdc47-fbbc-4cec-a5f3-ce2839feb14a tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 11:00:05.874031 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5dffdc47-fbbc-4cec-a5f3-ce2839feb14a tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 11:00:05.874461 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-5dffdc47-fbbc-4cec-a5f3-ce2839feb14a tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 11:00:06.023160 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-5dffdc47-fbbc-4cec-a5f3-ce2839feb14a tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f0ca4d2e5d4157a3e595e0787c0b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400e7fad8c43490d8510d77e6c10ce87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 11:00:06.033242 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-5dffdc47-fbbc-4cec-a5f3-ce2839feb14a tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] 10.222.0.48 "GET /compute/v2.1/servers/5d0fbaed-f809-449d-849c-d943e2abf8bc" status: 200 len: 1315 microversion: 2.1 time: 0.172043 Jul 21 11:00:06.033824 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 587/1165] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 11:00:05 2022] GET /compute/v2.1/servers/5d0fbaed-f809-449d-849c-d943e2abf8bc => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 11:00:07.051246 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-70baf75c-6231-4b16-9b98-b6df7b9fc966 tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 11:00:07.051855 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-70baf75c-6231-4b16-9b98-b6df7b9fc966 tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] [instance: 5d0fbaed-f809-449d-849c-d943e2abf8bc] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 11:00:07.059423 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-70baf75c-6231-4b16-9b98-b6df7b9fc966 tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 11:00:07.059866 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-70baf75c-6231-4b16-9b98-b6df7b9fc966 tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 11:00:07.060619 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-70baf75c-6231-4b16-9b98-b6df7b9fc966 tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 11:00:07.061046 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-70baf75c-6231-4b16-9b98-b6df7b9fc966 tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 11:00:07.191380 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-70baf75c-6231-4b16-9b98-b6df7b9fc966 tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f0ca4d2e5d4157a3e595e0787c0b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400e7fad8c43490d8510d77e6c10ce87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 11:00:07.198788 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-70baf75c-6231-4b16-9b98-b6df7b9fc966 tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] 10.222.0.48 "GET /compute/v2.1/servers/5d0fbaed-f809-449d-849c-d943e2abf8bc" status: 200 len: 1315 microversion: 2.1 time: 0.151402 Jul 21 11:00:07.199351 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 579/1166] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 11:00:07 2022] GET /compute/v2.1/servers/5d0fbaed-f809-449d-849c-d943e2abf8bc => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 11:00:08.216252 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-f7902009-5449-4045-ae1f-b61dca59060b tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 11:00:08.216861 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-f7902009-5449-4045-ae1f-b61dca59060b tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] [instance: 5d0fbaed-f809-449d-849c-d943e2abf8bc] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 11:00:08.223584 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f7902009-5449-4045-ae1f-b61dca59060b tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 11:00:08.224026 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f7902009-5449-4045-ae1f-b61dca59060b tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 11:00:08.224808 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f7902009-5449-4045-ae1f-b61dca59060b tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 11:00:08.225236 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-f7902009-5449-4045-ae1f-b61dca59060b tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 11:00:08.358469 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-f7902009-5449-4045-ae1f-b61dca59060b tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f0ca4d2e5d4157a3e595e0787c0b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400e7fad8c43490d8510d77e6c10ce87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 11:00:08.364683 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-f7902009-5449-4045-ae1f-b61dca59060b tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] 10.222.0.48 "GET /compute/v2.1/servers/5d0fbaed-f809-449d-849c-d943e2abf8bc" status: 200 len: 1315 microversion: 2.1 time: 0.152739 Jul 21 11:00:08.365253 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 588/1167] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 11:00:08 2022] GET /compute/v2.1/servers/5d0fbaed-f809-449d-849c-d943e2abf8bc => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 11:00:09.083879 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [req-0221ced4-80bd-4b1c-a57a-c5e5b9377c12 req-3c4131f0-5164-4dc5-a1f5-d87540f8c2ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d0fbaed-f809-449d-849c-d943e2abf8bc", "tag": "114a3322-232a-4df2-aaef-9e3a87d4ac9b"}]} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 11:00:09.093272 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-0221ced4-80bd-4b1c-a57a-c5e5b9377c12 req-3c4131f0-5164-4dc5-a1f5-d87540f8c2ef service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 11:00:09.094053 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-0221ced4-80bd-4b1c-a57a-c5e5b9377c12 req-3c4131f0-5164-4dc5-a1f5-d87540f8c2ef service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 11:00:09.105941 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.compute.server_external_events [req-0221ced4-80bd-4b1c-a57a-c5e5b9377c12 req-3c4131f0-5164-4dc5-a1f5-d87540f8c2ef service nova] Creating event network-changed:114a3322-232a-4df2-aaef-9e3a87d4ac9b for instance 5d0fbaed-f809-449d-849c-d943e2abf8bc on hv-cinder-84980 Jul 21 11:00:09.111091 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [req-0221ced4-80bd-4b1c-a57a-c5e5b9377c12 req-3c4131f0-5164-4dc5-a1f5-d87540f8c2ef service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031109 Jul 21 11:00:09.115262 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 580/1168] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 21 11:00:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 11:00:09.381972 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-0a7d2d0e-0fcb-48a5-b0c0-5b4314aa245a tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 11:00:09.382604 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-0a7d2d0e-0fcb-48a5-b0c0-5b4314aa245a tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] [instance: 5d0fbaed-f809-449d-849c-d943e2abf8bc] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 11:00:09.389860 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0a7d2d0e-0fcb-48a5-b0c0-5b4314aa245a tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 11:00:09.390369 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0a7d2d0e-0fcb-48a5-b0c0-5b4314aa245a tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 11:00:09.391257 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0a7d2d0e-0fcb-48a5-b0c0-5b4314aa245a tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 11:00:09.391685 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0a7d2d0e-0fcb-48a5-b0c0-5b4314aa245a tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 11:00:09.523452 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-0a7d2d0e-0fcb-48a5-b0c0-5b4314aa245a tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f0ca4d2e5d4157a3e595e0787c0b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400e7fad8c43490d8510d77e6c10ce87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 11:00:09.531655 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-0a7d2d0e-0fcb-48a5-b0c0-5b4314aa245a tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] 10.222.0.48 "GET /compute/v2.1/servers/5d0fbaed-f809-449d-849c-d943e2abf8bc" status: 200 len: 1315 microversion: 2.1 time: 0.154335 Jul 21 11:00:09.532315 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 589/1169] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 11:00:09 2022] GET /compute/v2.1/servers/5d0fbaed-f809-449d-849c-d943e2abf8bc => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 11:00:10.549582 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-b6d5448e-a177-4d41-958b-9fe94e45a407 tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 11:00:10.550286 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-b6d5448e-a177-4d41-958b-9fe94e45a407 tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] [instance: 5d0fbaed-f809-449d-849c-d943e2abf8bc] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 11:00:10.556629 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b6d5448e-a177-4d41-958b-9fe94e45a407 tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 11:00:10.567701 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b6d5448e-a177-4d41-958b-9fe94e45a407 tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 11:00:10.567701 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b6d5448e-a177-4d41-958b-9fe94e45a407 tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 11:00:10.567701 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-b6d5448e-a177-4d41-958b-9fe94e45a407 tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 11:00:10.690178 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-b6d5448e-a177-4d41-958b-9fe94e45a407 tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f0ca4d2e5d4157a3e595e0787c0b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400e7fad8c43490d8510d77e6c10ce87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 11:00:10.697501 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-b6d5448e-a177-4d41-958b-9fe94e45a407 tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] 10.222.0.48 "GET /compute/v2.1/servers/5d0fbaed-f809-449d-849c-d943e2abf8bc" status: 200 len: 1315 microversion: 2.1 time: 0.152751 Jul 21 11:00:10.698061 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 581/1170] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 11:00:10 2022] GET /compute/v2.1/servers/5d0fbaed-f809-449d-849c-d943e2abf8bc => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 11:00:11.715920 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-61270f98-b2cd-4aaf-b973-1855c585d878 tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 11:00:11.716576 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-61270f98-b2cd-4aaf-b973-1855c585d878 tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] [instance: 5d0fbaed-f809-449d-849c-d943e2abf8bc] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 11:00:11.723046 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-61270f98-b2cd-4aaf-b973-1855c585d878 tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 11:00:11.723492 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-61270f98-b2cd-4aaf-b973-1855c585d878 tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 11:00:11.724251 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-61270f98-b2cd-4aaf-b973-1855c585d878 tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 11:00:11.724681 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-61270f98-b2cd-4aaf-b973-1855c585d878 tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 11:00:11.849344 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-61270f98-b2cd-4aaf-b973-1855c585d878 tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f0ca4d2e5d4157a3e595e0787c0b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400e7fad8c43490d8510d77e6c10ce87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 11:00:11.857121 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-61270f98-b2cd-4aaf-b973-1855c585d878 tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] 10.222.0.48 "GET /compute/v2.1/servers/5d0fbaed-f809-449d-849c-d943e2abf8bc" status: 200 len: 1315 microversion: 2.1 time: 0.146221 Jul 21 11:00:11.857675 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 590/1171] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 11:00:11 2022] GET /compute/v2.1/servers/5d0fbaed-f809-449d-849c-d943e2abf8bc => generated 1315 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 11:00:12.874341 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-a5c5b8ca-af75-4143-a19c-30e0b52de32d tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 11:00:12.874918 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-a5c5b8ca-af75-4143-a19c-30e0b52de32d tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] [instance: 5d0fbaed-f809-449d-849c-d943e2abf8bc] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 11:00:12.877291 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell0:SELECT=2 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 11:00:12.882049 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a5c5b8ca-af75-4143-a19c-30e0b52de32d tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 11:00:12.882489 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a5c5b8ca-af75-4143-a19c-30e0b52de32d tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 11:00:12.883281 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a5c5b8ca-af75-4143-a19c-30e0b52de32d tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 11:00:12.883708 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-a5c5b8ca-af75-4143-a19c-30e0b52de32d tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 11:00:13.018289 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-a5c5b8ca-af75-4143-a19c-30e0b52de32d tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f0ca4d2e5d4157a3e595e0787c0b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400e7fad8c43490d8510d77e6c10ce87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 11:00:13.025711 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-a5c5b8ca-af75-4143-a19c-30e0b52de32d tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] 10.222.0.48 "GET /compute/v2.1/servers/5d0fbaed-f809-449d-849c-d943e2abf8bc" status: 200 len: 1315 microversion: 2.1 time: 0.155915 Jul 21 11:00:13.026282 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 582/1172] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 11:00:12 2022] GET /compute/v2.1/servers/5d0fbaed-f809-449d-849c-d943e2abf8bc => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 11:00:13.572615 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-898d46bb-061d-4619-b782-d8da203134d9 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1121144050", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-122371990", "security_groups": [{"name": "tempest-secgroup-smoke-926775298"}], "block_device_mapping_v2": [{"uuid": "7dd4ba06-52a9-4669-a847-65cdd9e735d4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "cc0b2a51-d561-47c8-bdc0-392c408f6063"}]}} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 11:00:13.581251 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell0:SELECT=2 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 11:00:13.584246 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell0:SELECT=6 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 11:00:13.685753 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.network.neutron [None req-898d46bb-061d-4619-b782-d8da203134d9 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] validate_networks() for [('cc0b2a51-d561-47c8-bdc0-392c408f6063', None, None, None, None, None)] {{(pid=124867) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 11:00:14.043938 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-9dda003f-0246-47b0-9b80-dfe188d1f5d8 tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 11:00:14.044592 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-9dda003f-0246-47b0-9b80-dfe188d1f5d8 tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] [instance: 5d0fbaed-f809-449d-849c-d943e2abf8bc] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 11:00:14.050976 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9dda003f-0246-47b0-9b80-dfe188d1f5d8 tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 11:00:14.051421 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9dda003f-0246-47b0-9b80-dfe188d1f5d8 tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 11:00:14.051955 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-898d46bb-061d-4619-b782-d8da203134d9 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Flavor limits 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 11:00:14.052178 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9dda003f-0246-47b0-9b80-dfe188d1f5d8 tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 11:00:14.052368 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-898d46bb-061d-4619-b782-d8da203134d9 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Image limits 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 11:00:14.052610 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-9dda003f-0246-47b0-9b80-dfe188d1f5d8 tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 11:00:14.052866 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-898d46bb-061d-4619-b782-d8da203134d9 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Flavor pref 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 11:00:14.053270 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-898d46bb-061d-4619-b782-d8da203134d9 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Image pref 0:0:0 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 11:00:14.053679 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.virt.hardware [None req-898d46bb-061d-4619-b782-d8da203134d9 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 11:00:14.063080 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-898d46bb-061d-4619-b782-d8da203134d9 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 11:00:14.063520 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-898d46bb-061d-4619-b782-d8da203134d9 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 11:00:14.064301 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-898d46bb-061d-4619-b782-d8da203134d9 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 11:00:14.064728 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-898d46bb-061d-4619-b782-d8da203134d9 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 11:00:14.082006 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.quota [None req-898d46bb-061d-4619-b782-d8da203134d9 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Getting quotas for project c99e5deac07a429c9c771ef41d278a46. Resources: {'ram', 'instances', 'cores'} {{(pid=124867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 11:00:14.085748 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.quota [None req-898d46bb-061d-4619-b782-d8da203134d9 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Getting quotas for user a0aebc4614c448bdb77fb167d4ae3de1 and project c99e5deac07a429c9c771ef41d278a46. Resources: {'ram', 'instances', 'cores'} {{(pid=124867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 11:00:14.143572 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-898d46bb-061d-4619-b782-d8da203134d9 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Going to run 1 instances... {{(pid=124867) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 11:00:14.145776 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-898d46bb-061d-4619-b782-d8da203134d9 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] [instance: 0e974eb5-69fa-4c06-834b-0d0cac61e5fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7dd4ba06-52a9-4669-a847-65cdd9e735d4',volume_size=None,volume_type=None)] {{(pid=124867) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 11:00:14.183029 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-9dda003f-0246-47b0-9b80-dfe188d1f5d8 tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f0ca4d2e5d4157a3e595e0787c0b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400e7fad8c43490d8510d77e6c10ce87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 11:00:14.191211 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-9dda003f-0246-47b0-9b80-dfe188d1f5d8 tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] 10.222.0.48 "GET /compute/v2.1/servers/5d0fbaed-f809-449d-849c-d943e2abf8bc" status: 200 len: 1315 microversion: 2.1 time: 0.152331 Jul 21 11:00:14.191830 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 583/1173] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 11:00:14 2022] GET /compute/v2.1/servers/5d0fbaed-f809-449d-849c-d943e2abf8bc => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 11:00:14.527086 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-898d46bb-061d-4619-b782-d8da203134d9 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.958240 Jul 21 11:00:14.528484 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 591/1174] 10.222.0.48 () {60 vars in 1146 bytes} [Thu Jul 21 11:00:13 2022] POST /compute/v2.1/servers => generated 405 bytes in 960 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 11:00:14.538727 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-3f893a62-f2a9-449e-aaca-6fa8246ff9d4 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 11:00:14.539594 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-3f893a62-f2a9-449e-aaca-6fa8246ff9d4 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] [instance: 0e974eb5-69fa-4c06-834b-0d0cac61e5fc] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 11:00:14.717555 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [req-39dd2c0e-1e88-41ef-8c7a-e5b65a8850ed req-5a02de7a-20df-466a-8298-4681ec1f0a36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d0fbaed-f809-449d-849c-d943e2abf8bc", "name": "network-vif-plugged", "status": "completed", "tag": "114a3322-232a-4df2-aaef-9e3a87d4ac9b"}]} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 11:00:14.728681 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-39dd2c0e-1e88-41ef-8c7a-e5b65a8850ed req-5a02de7a-20df-466a-8298-4681ec1f0a36 service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 11:00:14.732797 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-39dd2c0e-1e88-41ef-8c7a-e5b65a8850ed req-5a02de7a-20df-466a-8298-4681ec1f0a36 service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 11:00:14.741592 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.compute.server_external_events [req-39dd2c0e-1e88-41ef-8c7a-e5b65a8850ed req-5a02de7a-20df-466a-8298-4681ec1f0a36 service nova] Creating event network-vif-plugged:114a3322-232a-4df2-aaef-9e3a87d4ac9b for instance 5d0fbaed-f809-449d-849c-d943e2abf8bc on hv-cinder-84980 Jul 21 11:00:14.748312 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [req-39dd2c0e-1e88-41ef-8c7a-e5b65a8850ed req-5a02de7a-20df-466a-8298-4681ec1f0a36 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036831 Jul 21 11:00:14.748918 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 592/1175] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 21 11:00:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 11:00:14.860007 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-3f893a62-f2a9-449e-aaca-6fa8246ff9d4 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0aebc4614c448bdb77fb167d4ae3de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99e5deac07a429c9c771ef41d278a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 11:00:14.867092 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-3f893a62-f2a9-449e-aaca-6fa8246ff9d4 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] 10.222.0.48 "GET /compute/v2.1/servers/0e974eb5-69fa-4c06-834b-0d0cac61e5fc" status: 200 len: 1094 microversion: 2.1 time: 0.332140 Jul 21 11:00:14.867803 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 584/1176] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 11:00:14 2022] GET /compute/v2.1/servers/0e974eb5-69fa-4c06-834b-0d0cac61e5fc => generated 1094 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 11:00:15.208820 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-c5d07e23-0922-4b38-9ed3-1ec1de136deb tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 11:00:15.209570 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-c5d07e23-0922-4b38-9ed3-1ec1de136deb tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] [instance: 5d0fbaed-f809-449d-849c-d943e2abf8bc] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 11:00:15.215886 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c5d07e23-0922-4b38-9ed3-1ec1de136deb tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 11:00:15.216317 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c5d07e23-0922-4b38-9ed3-1ec1de136deb tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 11:00:15.217081 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c5d07e23-0922-4b38-9ed3-1ec1de136deb tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 11:00:15.217518 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c5d07e23-0922-4b38-9ed3-1ec1de136deb tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 11:00:15.346184 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-c5d07e23-0922-4b38-9ed3-1ec1de136deb tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f0ca4d2e5d4157a3e595e0787c0b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400e7fad8c43490d8510d77e6c10ce87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 11:00:15.353616 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-c5d07e23-0922-4b38-9ed3-1ec1de136deb tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] 10.222.0.48 "GET /compute/v2.1/servers/5d0fbaed-f809-449d-849c-d943e2abf8bc" status: 200 len: 1315 microversion: 2.1 time: 0.148972 Jul 21 11:00:15.354155 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 593/1177] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 11:00:15 2022] GET /compute/v2.1/servers/5d0fbaed-f809-449d-849c-d943e2abf8bc => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 11:00:15.885070 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-94caffd7-94c4-400c-b2b2-254f6002b949 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 11:00:15.885717 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-94caffd7-94c4-400c-b2b2-254f6002b949 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] [instance: 0e974eb5-69fa-4c06-834b-0d0cac61e5fc] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 11:00:15.892726 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-94caffd7-94c4-400c-b2b2-254f6002b949 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 11:00:15.893179 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-94caffd7-94c4-400c-b2b2-254f6002b949 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 11:00:15.893944 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-94caffd7-94c4-400c-b2b2-254f6002b949 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 11:00:15.894375 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-94caffd7-94c4-400c-b2b2-254f6002b949 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 11:00:15.955489 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-94caffd7-94c4-400c-b2b2-254f6002b949 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0aebc4614c448bdb77fb167d4ae3de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99e5deac07a429c9c771ef41d278a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 11:00:15.963069 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-94caffd7-94c4-400c-b2b2-254f6002b949 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] 10.222.0.48 "GET /compute/v2.1/servers/0e974eb5-69fa-4c06-834b-0d0cac61e5fc" status: 200 len: 1144 microversion: 2.1 time: 0.081865 Jul 21 11:00:15.963641 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 585/1178] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 11:00:15 2022] GET /compute/v2.1/servers/0e974eb5-69fa-4c06-834b-0d0cac61e5fc => generated 1144 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 11:00:16.369792 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-6db25cea-2baa-4a7f-992c-6c7aa0009424 tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 11:00:16.370391 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-6db25cea-2baa-4a7f-992c-6c7aa0009424 tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] [instance: 5d0fbaed-f809-449d-849c-d943e2abf8bc] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 11:00:16.377520 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6db25cea-2baa-4a7f-992c-6c7aa0009424 tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 11:00:16.377973 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6db25cea-2baa-4a7f-992c-6c7aa0009424 tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 11:00:16.378775 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6db25cea-2baa-4a7f-992c-6c7aa0009424 tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 11:00:16.379212 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-6db25cea-2baa-4a7f-992c-6c7aa0009424 tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 11:00:16.509384 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-6db25cea-2baa-4a7f-992c-6c7aa0009424 tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f0ca4d2e5d4157a3e595e0787c0b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400e7fad8c43490d8510d77e6c10ce87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 11:00:16.517493 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-6db25cea-2baa-4a7f-992c-6c7aa0009424 tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] 10.222.0.48 "GET /compute/v2.1/servers/5d0fbaed-f809-449d-849c-d943e2abf8bc" status: 200 len: 1465 microversion: 2.1 time: 0.151608 Jul 21 11:00:16.518050 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 594/1179] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 11:00:16 2022] GET /compute/v2.1/servers/5d0fbaed-f809-449d-849c-d943e2abf8bc => generated 1465 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 11:00:16.557040 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-23655807-c0fc-45c1-95af-746e6e1b6da1 tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 11:00:16.557538 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-23655807-c0fc-45c1-95af-746e6e1b6da1 tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] [instance: 5d0fbaed-f809-449d-849c-d943e2abf8bc] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 11:00:16.564180 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-23655807-c0fc-45c1-95af-746e6e1b6da1 tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 11:00:16.564631 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-23655807-c0fc-45c1-95af-746e6e1b6da1 tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 11:00:16.565393 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-23655807-c0fc-45c1-95af-746e6e1b6da1 tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 11:00:16.565832 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-23655807-c0fc-45c1-95af-746e6e1b6da1 tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 11:00:16.591640 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-23655807-c0fc-45c1-95af-746e6e1b6da1 tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] [instance: 5d0fbaed-f809-449d-849c-d943e2abf8bc] Going to try to terminate instance {{(pid=124868) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 11:00:16.940784 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-23655807-c0fc-45c1-95af-746e6e1b6da1 tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] 10.222.0.48 "DELETE /compute/v2.1/servers/5d0fbaed-f809-449d-849c-d943e2abf8bc" status: 204 len: 0 microversion: 2.1 time: 0.387250 Jul 21 11:00:16.941485 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 586/1180] 10.222.0.48 () {58 vars in 1238 bytes} [Thu Jul 21 11:00:16 2022] DELETE /compute/v2.1/servers/5d0fbaed-f809-449d-849c-d943e2abf8bc => generated 0 bytes in 389 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 11:00:16.949462 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-858c00a2-9bf6-41ef-b6c1-aa087103531c tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 11:00:16.950108 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-858c00a2-9bf6-41ef-b6c1-aa087103531c tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] [instance: 5d0fbaed-f809-449d-849c-d943e2abf8bc] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 11:00:16.956370 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-858c00a2-9bf6-41ef-b6c1-aa087103531c tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 11:00:16.956812 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-858c00a2-9bf6-41ef-b6c1-aa087103531c tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 11:00:16.957560 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-858c00a2-9bf6-41ef-b6c1-aa087103531c tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 11:00:16.957997 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-858c00a2-9bf6-41ef-b6c1-aa087103531c tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 11:00:16.982489 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-12046beb-9276-4efe-b306-2131989a083b tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 11:00:16.983258 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-12046beb-9276-4efe-b306-2131989a083b tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] [instance: 0e974eb5-69fa-4c06-834b-0d0cac61e5fc] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 11:00:16.989915 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-12046beb-9276-4efe-b306-2131989a083b tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 11:00:16.990374 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-12046beb-9276-4efe-b306-2131989a083b tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 11:00:16.991176 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-12046beb-9276-4efe-b306-2131989a083b tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 11:00:16.991615 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-12046beb-9276-4efe-b306-2131989a083b tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 11:00:17.059133 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-12046beb-9276-4efe-b306-2131989a083b tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0aebc4614c448bdb77fb167d4ae3de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99e5deac07a429c9c771ef41d278a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 11:00:17.067900 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-12046beb-9276-4efe-b306-2131989a083b tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] 10.222.0.48 "GET /compute/v2.1/servers/0e974eb5-69fa-4c06-834b-0d0cac61e5fc" status: 200 len: 1192 microversion: 2.1 time: 0.090364 Jul 21 11:00:17.068479 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 587/1181] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 11:00:16 2022] GET /compute/v2.1/servers/0e974eb5-69fa-4c06-834b-0d0cac61e5fc => generated 1192 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 11:00:17.118593 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-858c00a2-9bf6-41ef-b6c1-aa087103531c tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f0ca4d2e5d4157a3e595e0787c0b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400e7fad8c43490d8510d77e6c10ce87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 11:00:17.126444 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-858c00a2-9bf6-41ef-b6c1-aa087103531c tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] 10.222.0.48 "GET /compute/v2.1/servers/5d0fbaed-f809-449d-849c-d943e2abf8bc" status: 200 len: 1471 microversion: 2.1 time: 0.180871 Jul 21 11:00:17.127040 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 595/1182] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 11:00:16 2022] GET /compute/v2.1/servers/5d0fbaed-f809-449d-849c-d943e2abf8bc => generated 1471 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 11:00:18.085714 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-930f0c32-3a35-49e6-b669-bf9bc783e75a tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 11:00:18.086253 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-930f0c32-3a35-49e6-b669-bf9bc783e75a tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] [instance: 0e974eb5-69fa-4c06-834b-0d0cac61e5fc] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 11:00:18.092830 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-930f0c32-3a35-49e6-b669-bf9bc783e75a tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 11:00:18.094000 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-930f0c32-3a35-49e6-b669-bf9bc783e75a tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 11:00:18.094175 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-930f0c32-3a35-49e6-b669-bf9bc783e75a tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 11:00:18.094633 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-930f0c32-3a35-49e6-b669-bf9bc783e75a tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 11:00:18.143723 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-e130f20b-acb9-44b4-9514-940a555bf5f5 tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 11:00:18.147082 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-e130f20b-acb9-44b4-9514-940a555bf5f5 tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] [instance: 5d0fbaed-f809-449d-849c-d943e2abf8bc] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 11:00:18.155032 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e130f20b-acb9-44b4-9514-940a555bf5f5 tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 11:00:18.155482 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e130f20b-acb9-44b4-9514-940a555bf5f5 tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 11:00:18.156262 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e130f20b-acb9-44b4-9514-940a555bf5f5 tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 11:00:18.156703 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-e130f20b-acb9-44b4-9514-940a555bf5f5 tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 11:00:18.164006 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-930f0c32-3a35-49e6-b669-bf9bc783e75a tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0aebc4614c448bdb77fb167d4ae3de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99e5deac07a429c9c771ef41d278a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 11:00:18.172817 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-930f0c32-3a35-49e6-b669-bf9bc783e75a tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] 10.222.0.48 "GET /compute/v2.1/servers/0e974eb5-69fa-4c06-834b-0d0cac61e5fc" status: 200 len: 1200 microversion: 2.1 time: 0.091182 Jul 21 11:00:18.173385 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 588/1183] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 11:00:18 2022] GET /compute/v2.1/servers/0e974eb5-69fa-4c06-834b-0d0cac61e5fc => generated 1200 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 11:00:18.289057 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-e130f20b-acb9-44b4-9514-940a555bf5f5 tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f0ca4d2e5d4157a3e595e0787c0b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400e7fad8c43490d8510d77e6c10ce87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 11:00:18.297490 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-e130f20b-acb9-44b4-9514-940a555bf5f5 tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] 10.222.0.48 "GET /compute/v2.1/servers/5d0fbaed-f809-449d-849c-d943e2abf8bc" status: 200 len: 1471 microversion: 2.1 time: 0.157706 Jul 21 11:00:18.300091 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 596/1184] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 11:00:18 2022] GET /compute/v2.1/servers/5d0fbaed-f809-449d-849c-d943e2abf8bc => generated 1471 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 11:00:19.168271 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [req-0b37ec24-f8f9-4d8c-882e-3d3c13ced734 req-4edcce2f-351f-4d75-9a5c-aa189db95acd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d0fbaed-f809-449d-849c-d943e2abf8bc", "name": "network-vif-deleted", "tag": "114a3322-232a-4df2-aaef-9e3a87d4ac9b"}]} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 11:00:19.178480 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-0b37ec24-f8f9-4d8c-882e-3d3c13ced734 req-4edcce2f-351f-4d75-9a5c-aa189db95acd service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 11:00:19.179016 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-0b37ec24-f8f9-4d8c-882e-3d3c13ced734 req-4edcce2f-351f-4d75-9a5c-aa189db95acd service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 11:00:19.189901 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-11cd7bae-1a38-4160-a97d-7c65afa8fbca tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 11:00:19.191192 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-11cd7bae-1a38-4160-a97d-7c65afa8fbca tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] [instance: 0e974eb5-69fa-4c06-834b-0d0cac61e5fc] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 11:00:19.196400 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.compute.server_external_events [req-0b37ec24-f8f9-4d8c-882e-3d3c13ced734 req-4edcce2f-351f-4d75-9a5c-aa189db95acd service nova] Creating event network-vif-deleted:114a3322-232a-4df2-aaef-9e3a87d4ac9b for instance 5d0fbaed-f809-449d-849c-d943e2abf8bc on hv-cinder-84980 Jul 21 11:00:19.198626 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-11cd7bae-1a38-4160-a97d-7c65afa8fbca tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 11:00:19.199383 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-11cd7bae-1a38-4160-a97d-7c65afa8fbca tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 11:00:19.200394 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-11cd7bae-1a38-4160-a97d-7c65afa8fbca tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 11:00:19.200995 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-11cd7bae-1a38-4160-a97d-7c65afa8fbca tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 11:00:19.204617 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [req-0b37ec24-f8f9-4d8c-882e-3d3c13ced734 req-4edcce2f-351f-4d75-9a5c-aa189db95acd service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040251 Jul 21 11:00:19.205645 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 589/1185] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 21 11:00:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 11:00:19.274356 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-11cd7bae-1a38-4160-a97d-7c65afa8fbca tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0aebc4614c448bdb77fb167d4ae3de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99e5deac07a429c9c771ef41d278a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 11:00:19.282882 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-11cd7bae-1a38-4160-a97d-7c65afa8fbca tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] 10.222.0.48 "GET /compute/v2.1/servers/0e974eb5-69fa-4c06-834b-0d0cac61e5fc" status: 200 len: 1210 microversion: 2.1 time: 0.096872 Jul 21 11:00:19.283620 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 597/1186] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 11:00:19 2022] GET /compute/v2.1/servers/0e974eb5-69fa-4c06-834b-0d0cac61e5fc => generated 1210 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 11:00:19.315596 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-cc447ee4-15af-42f1-9e35-65e2518660d0 tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 11:00:19.316293 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-cc447ee4-15af-42f1-9e35-65e2518660d0 tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] [instance: 5d0fbaed-f809-449d-849c-d943e2abf8bc] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 11:00:19.322633 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-cc447ee4-15af-42f1-9e35-65e2518660d0 tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 11:00:19.323084 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-cc447ee4-15af-42f1-9e35-65e2518660d0 tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 11:00:19.323877 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-cc447ee4-15af-42f1-9e35-65e2518660d0 tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 11:00:19.324309 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-cc447ee4-15af-42f1-9e35-65e2518660d0 tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 11:00:19.408923 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-cc447ee4-15af-42f1-9e35-65e2518660d0 tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f0ca4d2e5d4157a3e595e0787c0b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400e7fad8c43490d8510d77e6c10ce87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 11:00:19.418490 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-cc447ee4-15af-42f1-9e35-65e2518660d0 tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] 10.222.0.48 "GET /compute/v2.1/servers/5d0fbaed-f809-449d-849c-d943e2abf8bc" status: 200 len: 1300 microversion: 2.1 time: 0.105949 Jul 21 11:00:19.427516 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 590/1187] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 11:00:19 2022] GET /compute/v2.1/servers/5d0fbaed-f809-449d-849c-d943e2abf8bc => generated 1300 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 11:00:20.301087 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-47ba7aba-4423-413b-bd73-5ed913e2a862 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 11:00:20.301704 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-47ba7aba-4423-413b-bd73-5ed913e2a862 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] [instance: 0e974eb5-69fa-4c06-834b-0d0cac61e5fc] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 11:00:20.310958 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-47ba7aba-4423-413b-bd73-5ed913e2a862 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 11:00:20.310958 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-47ba7aba-4423-413b-bd73-5ed913e2a862 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 11:00:20.310958 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-47ba7aba-4423-413b-bd73-5ed913e2a862 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 11:00:20.310958 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-47ba7aba-4423-413b-bd73-5ed913e2a862 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 11:00:20.434912 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-f1999652-734a-4abb-afff-e4fcc76177b1 tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 11:00:20.439379 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-f1999652-734a-4abb-afff-e4fcc76177b1 tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] [instance: 5d0fbaed-f809-449d-849c-d943e2abf8bc] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 11:00:20.442327 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f1999652-734a-4abb-afff-e4fcc76177b1 tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 11:00:20.442812 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f1999652-734a-4abb-afff-e4fcc76177b1 tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 11:00:20.443586 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f1999652-734a-4abb-afff-e4fcc76177b1 tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 11:00:20.444013 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-f1999652-734a-4abb-afff-e4fcc76177b1 tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 11:00:20.462310 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.wsgi [None req-f1999652-734a-4abb-afff-e4fcc76177b1 tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] HTTP exception thrown: Instance 5d0fbaed-f809-449d-849c-d943e2abf8bc could not be found. Jul 21 11:00:20.466755 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-f1999652-734a-4abb-afff-e4fcc76177b1 tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] Request method failure captured: Jul 21 11:00:20.466755 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: request: GET /compute/v2.1/servers/5d0fbaed-f809-449d-849c-d943e2abf8bc HTTP/1.1 Jul 21 11:00:20.466755 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Accept: application/json Jul 21 11:00:20.466755 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Accept-Encoding: identity Jul 21 11:00:20.466755 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Connection: close Jul 21 11:00:20.466755 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Content-Length: 0 Jul 21 11:00:20.466755 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Content-Type: application/json Jul 21 11:00:20.466755 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Host: 10.222.0.48 Jul 21 11:00:20.466755 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Openstack-System-Scope: None Jul 21 11:00:20.466755 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: User-Agent: python-urllib3/1.26.9 Jul 21 11:00:20.466755 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Auth-Token: gAAAAABi2TGw2rlwO_kvKaGcbQUf1sg1rCdyklfOq5pB2kt05TmKRkU6AwYbMk0iBD_euPHnyZpgZYSLYicvrWjv6sNVkfYfGdy-64lPvqVp1MGQjRde22YBKuPHszkRpAxBj30lhmzu8A7ZxbNrBk7VYP4_MbBudptNRuY1pu1Vyg4D9TsYeqo Jul 21 11:00:20.466755 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Domain-Id: None Jul 21 11:00:20.466755 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Domain-Name: None Jul 21 11:00:20.466755 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Identity-Status: Confirmed Jul 21 11:00:20.466755 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Is-Admin-Project: True Jul 21 11:00:20.466755 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Domain-Id: default Jul 21 11:00:20.466755 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Domain-Name: Default Jul 21 11:00:20.466755 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Id: 400e7fad8c43490d8510d77e6c10ce87 Jul 21 11:00:20.466755 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Name: tempest-VolumesNegativeTest-984160158 Jul 21 11:00:20.466755 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Role: reader,member Jul 21 11:00:20.466755 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Roles: reader,member Jul 21 11:00:20.469159 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/400e7fad8c43490d8510d77e6c10ce87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/400e7fad8c43490d8510d77e6c10ce87"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/400e7fad8c43490d8510d77e6c10ce87"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_400e7fad8c43490d8510d77e6c10ce87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] Jul 21 11:00:20.469159 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Tenant: tempest-VolumesNegativeTest-984160158 Jul 21 11:00:20.469159 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Tenant-Id: 400e7fad8c43490d8510d77e6c10ce87 Jul 21 11:00:20.469159 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Tenant-Name: tempest-VolumesNegativeTest-984160158 Jul 21 11:00:20.469159 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User: tempest-VolumesNegativeTest-984160158-project Jul 21 11:00:20.469159 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Domain-Id: default Jul 21 11:00:20.469159 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Domain-Name: Default Jul 21 11:00:20.469159 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Id: d2f0ca4d2e5d4157a3e595e0787c0b93 Jul 21 11:00:20.469159 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Name: tempest-VolumesNegativeTest-984160158-project Jul 21 11:00:20.469159 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: method: > Jul 21 11:00:20.469159 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: exception: Instance 5d0fbaed-f809-449d-849c-d943e2abf8bc could not be found. Jul 21 11:00:20.469159 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: action_args: {'id': '5d0fbaed-f809-449d-849c-d943e2abf8bc'} Jul 21 11:00:20.470791 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 11:00:20.470791 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 11:00:20.470791 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 11:00:20.470791 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 11:00:20.470791 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 11:00:20.470791 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 11:00:20.470791 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 11:00:20.470791 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 11:00:20.470791 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 11:00:20.470791 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 11:00:20.470791 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d0fbaed-f809-449d-849c-d943e2abf8bc could not be found. Jul 21 11:00:20.470791 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 11:00:20.470791 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 11:00:20.470791 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 11:00:20.470791 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 11:00:20.470791 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 11:00:20.470791 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 11:00:20.470791 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 11:00:20.470791 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 11:00:20.470791 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 11:00:20.475945 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 11:00:20.475945 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 11:00:20.475945 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 11:00:20.475945 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 11:00:20.475945 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 11:00:20.475945 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 11:00:20.475945 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 11:00:20.475945 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d0fbaed-f809-449d-849c-d943e2abf8bc could not be found. Jul 21 11:00:20.475945 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 11:00:20.475945 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 11:00:20.475945 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 11:00:20.475945 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 11:00:20.475945 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 11:00:20.475945 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 11:00:20.475945 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 11:00:20.475945 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 11:00:20.475945 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d0fbaed-f809-449d-849c-d943e2abf8bc could not be found. Jul 21 11:00:20.475945 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 11:00:20.482877 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-47ba7aba-4423-413b-bd73-5ed913e2a862 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0aebc4614c448bdb77fb167d4ae3de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99e5deac07a429c9c771ef41d278a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 11:00:20.483478 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-f1999652-734a-4abb-afff-e4fcc76177b1 tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] Returning 404 to user: Instance 5d0fbaed-f809-449d-849c-d943e2abf8bc could not be found. {{(pid=124868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 11:00:20.483478 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-f1999652-734a-4abb-afff-e4fcc76177b1 tempest-VolumesNegativeTest-984160158 tempest-VolumesNegativeTest-984160158-project] 10.222.0.48 "GET /compute/v2.1/servers/5d0fbaed-f809-449d-849c-d943e2abf8bc" status: 404 len: 111 microversion: 2.1 time: 0.041830 Jul 21 11:00:20.483478 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 591/1188] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 11:00:20 2022] GET /compute/v2.1/servers/5d0fbaed-f809-449d-849c-d943e2abf8bc => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 21 11:00:20.503516 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-47ba7aba-4423-413b-bd73-5ed913e2a862 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] 10.222.0.48 "GET /compute/v2.1/servers/0e974eb5-69fa-4c06-834b-0d0cac61e5fc" status: 200 len: 1265 microversion: 2.1 time: 0.185487 Jul 21 11:00:20.503516 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 598/1189] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 11:00:20 2022] GET /compute/v2.1/servers/0e974eb5-69fa-4c06-834b-0d0cac61e5fc => generated 1265 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 11:00:21.220326 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [req-563a0f6e-b182-42a1-8012-8ac44fa43180 req-17a6e755-03d1-4b98-994e-1b2e8d8eb347 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e974eb5-69fa-4c06-834b-0d0cac61e5fc", "tag": "8303bb45-ee07-47e1-903d-fbf67104800b"}]} {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 11:00:21.228133 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-563a0f6e-b182-42a1-8012-8ac44fa43180 req-17a6e755-03d1-4b98-994e-1b2e8d8eb347 service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 11:00:21.228568 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [req-563a0f6e-b182-42a1-8012-8ac44fa43180 req-17a6e755-03d1-4b98-994e-1b2e8d8eb347 service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 11:00:21.240476 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.compute.server_external_events [req-563a0f6e-b182-42a1-8012-8ac44fa43180 req-17a6e755-03d1-4b98-994e-1b2e8d8eb347 service nova] Creating event network-changed:8303bb45-ee07-47e1-903d-fbf67104800b for instance 0e974eb5-69fa-4c06-834b-0d0cac61e5fc on hv-cinder-84980 Jul 21 11:00:21.245248 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [req-563a0f6e-b182-42a1-8012-8ac44fa43180 req-17a6e755-03d1-4b98-994e-1b2e8d8eb347 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028787 Jul 21 11:00:21.245836 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 592/1190] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 21 11:00:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 11:00:21.505287 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-cfcc6d48-514e-4b4a-8a6b-dc3d57ed7e8b tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 11:00:21.506100 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-cfcc6d48-514e-4b4a-8a6b-dc3d57ed7e8b tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] [instance: 0e974eb5-69fa-4c06-834b-0d0cac61e5fc] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 11:00:21.512780 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-cfcc6d48-514e-4b4a-8a6b-dc3d57ed7e8b tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 11:00:21.513286 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-cfcc6d48-514e-4b4a-8a6b-dc3d57ed7e8b tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 11:00:21.514143 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-cfcc6d48-514e-4b4a-8a6b-dc3d57ed7e8b tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 11:00:21.514671 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-cfcc6d48-514e-4b4a-8a6b-dc3d57ed7e8b tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 11:00:21.672998 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-cfcc6d48-514e-4b4a-8a6b-dc3d57ed7e8b tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0aebc4614c448bdb77fb167d4ae3de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99e5deac07a429c9c771ef41d278a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 11:00:21.680750 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-cfcc6d48-514e-4b4a-8a6b-dc3d57ed7e8b tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] 10.222.0.48 "GET /compute/v2.1/servers/0e974eb5-69fa-4c06-834b-0d0cac61e5fc" status: 200 len: 1265 microversion: 2.1 time: 0.179335 Jul 21 11:00:21.681459 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 599/1191] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 11:00:21 2022] GET /compute/v2.1/servers/0e974eb5-69fa-4c06-834b-0d0cac61e5fc => generated 1265 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 11:00:22.698585 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-367e14ff-615f-46a0-bd1f-e96eb0910955 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 11:00:22.699230 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-367e14ff-615f-46a0-bd1f-e96eb0910955 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] [instance: 0e974eb5-69fa-4c06-834b-0d0cac61e5fc] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 11:00:22.705865 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-367e14ff-615f-46a0-bd1f-e96eb0910955 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 11:00:22.707725 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-367e14ff-615f-46a0-bd1f-e96eb0910955 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 11:00:22.707725 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-367e14ff-615f-46a0-bd1f-e96eb0910955 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 11:00:22.707725 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-367e14ff-615f-46a0-bd1f-e96eb0910955 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 11:00:22.839776 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-367e14ff-615f-46a0-bd1f-e96eb0910955 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0aebc4614c448bdb77fb167d4ae3de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99e5deac07a429c9c771ef41d278a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 11:00:22.847479 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-367e14ff-615f-46a0-bd1f-e96eb0910955 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] 10.222.0.48 "GET /compute/v2.1/servers/0e974eb5-69fa-4c06-834b-0d0cac61e5fc" status: 200 len: 1265 microversion: 2.1 time: 0.153618 Jul 21 11:00:22.848051 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 593/1192] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 11:00:22 2022] GET /compute/v2.1/servers/0e974eb5-69fa-4c06-834b-0d0cac61e5fc => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 11:00:23.864798 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-3120a51d-a38d-4cf9-a427-39ab2794ff25 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 11:00:23.865513 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-3120a51d-a38d-4cf9-a427-39ab2794ff25 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] [instance: 0e974eb5-69fa-4c06-834b-0d0cac61e5fc] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 11:00:23.871959 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3120a51d-a38d-4cf9-a427-39ab2794ff25 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 11:00:23.872488 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3120a51d-a38d-4cf9-a427-39ab2794ff25 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 11:00:23.873504 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3120a51d-a38d-4cf9-a427-39ab2794ff25 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 11:00:23.874443 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-3120a51d-a38d-4cf9-a427-39ab2794ff25 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 11:00:24.009339 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-3120a51d-a38d-4cf9-a427-39ab2794ff25 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0aebc4614c448bdb77fb167d4ae3de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99e5deac07a429c9c771ef41d278a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 11:00:24.016956 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-3120a51d-a38d-4cf9-a427-39ab2794ff25 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] 10.222.0.48 "GET /compute/v2.1/servers/0e974eb5-69fa-4c06-834b-0d0cac61e5fc" status: 200 len: 1265 microversion: 2.1 time: 0.155978 Jul 21 11:00:24.017515 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 600/1193] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 11:00:23 2022] GET /compute/v2.1/servers/0e974eb5-69fa-4c06-834b-0d0cac61e5fc => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 11:00:25.034677 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-7bd42744-8191-47eb-a88b-02ddac928c6a tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 11:00:25.035232 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-7bd42744-8191-47eb-a88b-02ddac928c6a tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] [instance: 0e974eb5-69fa-4c06-834b-0d0cac61e5fc] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 11:00:25.037937 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell0:SELECT=2 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 11:00:25.044649 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7bd42744-8191-47eb-a88b-02ddac928c6a tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 11:00:25.044649 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7bd42744-8191-47eb-a88b-02ddac928c6a tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 11:00:25.044649 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7bd42744-8191-47eb-a88b-02ddac928c6a tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 11:00:25.044649 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-7bd42744-8191-47eb-a88b-02ddac928c6a tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 11:00:25.182826 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-7bd42744-8191-47eb-a88b-02ddac928c6a tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0aebc4614c448bdb77fb167d4ae3de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99e5deac07a429c9c771ef41d278a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 11:00:25.191314 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-7bd42744-8191-47eb-a88b-02ddac928c6a tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] 10.222.0.48 "GET /compute/v2.1/servers/0e974eb5-69fa-4c06-834b-0d0cac61e5fc" status: 200 len: 1265 microversion: 2.1 time: 0.161852 Jul 21 11:00:25.191891 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 594/1194] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 11:00:25 2022] GET /compute/v2.1/servers/0e974eb5-69fa-4c06-834b-0d0cac61e5fc => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 11:00:26.209227 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-0e8821c3-fb10-4d5b-8225-b67b0df12343 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 11:00:26.211214 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-0e8821c3-fb10-4d5b-8225-b67b0df12343 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] [instance: 0e974eb5-69fa-4c06-834b-0d0cac61e5fc] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 11:00:26.212966 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell0:SELECT=2 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 11:00:26.213612 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell0:SELECT=6 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 11:00:26.217663 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0e8821c3-fb10-4d5b-8225-b67b0df12343 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 11:00:26.218109 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0e8821c3-fb10-4d5b-8225-b67b0df12343 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 11:00:26.219034 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0e8821c3-fb10-4d5b-8225-b67b0df12343 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 11:00:26.219474 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0e8821c3-fb10-4d5b-8225-b67b0df12343 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 11:00:26.352236 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-0e8821c3-fb10-4d5b-8225-b67b0df12343 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0aebc4614c448bdb77fb167d4ae3de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99e5deac07a429c9c771ef41d278a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 11:00:26.361000 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-0e8821c3-fb10-4d5b-8225-b67b0df12343 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] 10.222.0.48 "GET /compute/v2.1/servers/0e974eb5-69fa-4c06-834b-0d0cac61e5fc" status: 200 len: 1265 microversion: 2.1 time: 0.155648 Jul 21 11:00:26.361571 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 601/1195] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 11:00:26 2022] GET /compute/v2.1/servers/0e974eb5-69fa-4c06-834b-0d0cac61e5fc => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 11:00:27.378177 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-e0f82b38-19fc-4c19-b4d7-5bc5d77c7b34 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 11:00:27.378849 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-e0f82b38-19fc-4c19-b4d7-5bc5d77c7b34 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] [instance: 0e974eb5-69fa-4c06-834b-0d0cac61e5fc] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 11:00:27.385400 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e0f82b38-19fc-4c19-b4d7-5bc5d77c7b34 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 11:00:27.385895 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e0f82b38-19fc-4c19-b4d7-5bc5d77c7b34 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 11:00:27.389474 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e0f82b38-19fc-4c19-b4d7-5bc5d77c7b34 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 11:00:27.389474 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-e0f82b38-19fc-4c19-b4d7-5bc5d77c7b34 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 11:00:27.520409 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-e0f82b38-19fc-4c19-b4d7-5bc5d77c7b34 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0aebc4614c448bdb77fb167d4ae3de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99e5deac07a429c9c771ef41d278a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 11:00:27.527894 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-e0f82b38-19fc-4c19-b4d7-5bc5d77c7b34 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] 10.222.0.48 "GET /compute/v2.1/servers/0e974eb5-69fa-4c06-834b-0d0cac61e5fc" status: 200 len: 1265 microversion: 2.1 time: 0.154106 Jul 21 11:00:27.528451 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 595/1196] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 11:00:27 2022] GET /compute/v2.1/servers/0e974eb5-69fa-4c06-834b-0d0cac61e5fc => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 11:00:28.545116 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-0f262809-5806-42c1-8a42-60dd42501994 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 11:00:28.546684 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-0f262809-5806-42c1-8a42-60dd42501994 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] [instance: 0e974eb5-69fa-4c06-834b-0d0cac61e5fc] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 11:00:28.553095 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0f262809-5806-42c1-8a42-60dd42501994 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 11:00:28.553540 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0f262809-5806-42c1-8a42-60dd42501994 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 11:00:28.554287 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0f262809-5806-42c1-8a42-60dd42501994 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 11:00:28.554752 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0f262809-5806-42c1-8a42-60dd42501994 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 11:00:28.690159 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-0f262809-5806-42c1-8a42-60dd42501994 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0aebc4614c448bdb77fb167d4ae3de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99e5deac07a429c9c771ef41d278a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 11:00:28.697474 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-0f262809-5806-42c1-8a42-60dd42501994 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] 10.222.0.48 "GET /compute/v2.1/servers/0e974eb5-69fa-4c06-834b-0d0cac61e5fc" status: 200 len: 1265 microversion: 2.1 time: 0.156276 Jul 21 11:00:28.698029 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 602/1197] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 11:00:28 2022] GET /compute/v2.1/servers/0e974eb5-69fa-4c06-834b-0d0cac61e5fc => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 11:00:29.715461 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-10d16c33-ddbd-4b1c-8bd4-812914e660bb tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 11:00:29.716068 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-10d16c33-ddbd-4b1c-8bd4-812914e660bb tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] [instance: 0e974eb5-69fa-4c06-834b-0d0cac61e5fc] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 11:00:29.722346 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-10d16c33-ddbd-4b1c-8bd4-812914e660bb tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 11:00:29.722826 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-10d16c33-ddbd-4b1c-8bd4-812914e660bb tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 11:00:29.723584 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-10d16c33-ddbd-4b1c-8bd4-812914e660bb tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 11:00:29.724013 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-10d16c33-ddbd-4b1c-8bd4-812914e660bb tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 11:00:29.742234 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 11:00:29.857997 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-10d16c33-ddbd-4b1c-8bd4-812914e660bb tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0aebc4614c448bdb77fb167d4ae3de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99e5deac07a429c9c771ef41d278a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 11:00:29.865879 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-10d16c33-ddbd-4b1c-8bd4-812914e660bb tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] 10.222.0.48 "GET /compute/v2.1/servers/0e974eb5-69fa-4c06-834b-0d0cac61e5fc" status: 200 len: 1265 microversion: 2.1 time: 0.154220 Jul 21 11:00:29.866461 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 596/1198] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 11:00:29 2022] GET /compute/v2.1/servers/0e974eb5-69fa-4c06-834b-0d0cac61e5fc => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 11:00:30.883756 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-8353da6f-8794-4099-bbd2-e5c316feb42c tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 11:00:30.884361 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-8353da6f-8794-4099-bbd2-e5c316feb42c tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] [instance: 0e974eb5-69fa-4c06-834b-0d0cac61e5fc] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 11:00:30.890968 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8353da6f-8794-4099-bbd2-e5c316feb42c tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 11:00:30.891406 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8353da6f-8794-4099-bbd2-e5c316feb42c tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 11:00:30.905299 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8353da6f-8794-4099-bbd2-e5c316feb42c tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 11:00:30.905299 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-8353da6f-8794-4099-bbd2-e5c316feb42c tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 11:00:30.910098 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell1:SELECT=100 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 11:00:31.027306 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-8353da6f-8794-4099-bbd2-e5c316feb42c tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0aebc4614c448bdb77fb167d4ae3de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99e5deac07a429c9c771ef41d278a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 11:00:31.035482 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-8353da6f-8794-4099-bbd2-e5c316feb42c tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] 10.222.0.48 "GET /compute/v2.1/servers/0e974eb5-69fa-4c06-834b-0d0cac61e5fc" status: 200 len: 1265 microversion: 2.1 time: 0.155517 Jul 21 11:00:31.036043 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 603/1199] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 11:00:30 2022] GET /compute/v2.1/servers/0e974eb5-69fa-4c06-834b-0d0cac61e5fc => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 11:00:32.052768 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-61a3e279-adcf-4369-8af3-53f08e514544 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 11:00:32.053440 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-61a3e279-adcf-4369-8af3-53f08e514544 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] [instance: 0e974eb5-69fa-4c06-834b-0d0cac61e5fc] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 11:00:32.059893 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-61a3e279-adcf-4369-8af3-53f08e514544 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 11:00:32.060335 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-61a3e279-adcf-4369-8af3-53f08e514544 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 11:00:32.061119 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-61a3e279-adcf-4369-8af3-53f08e514544 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 11:00:32.061517 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-61a3e279-adcf-4369-8af3-53f08e514544 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 11:00:32.191756 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-61a3e279-adcf-4369-8af3-53f08e514544 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0aebc4614c448bdb77fb167d4ae3de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99e5deac07a429c9c771ef41d278a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 11:00:32.199349 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-61a3e279-adcf-4369-8af3-53f08e514544 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] 10.222.0.48 "GET /compute/v2.1/servers/0e974eb5-69fa-4c06-834b-0d0cac61e5fc" status: 200 len: 1265 microversion: 2.1 time: 0.150241 Jul 21 11:00:32.199915 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 597/1200] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 11:00:32 2022] GET /compute/v2.1/servers/0e974eb5-69fa-4c06-834b-0d0cac61e5fc => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 11:00:32.757050 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [req-b4fdff95-5985-4455-b99c-658a2fd79ebf req-76560c4e-0d83-42e0-9424-85a8b1fd9a68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e974eb5-69fa-4c06-834b-0d0cac61e5fc", "name": "network-vif-plugged", "status": "completed", "tag": "8303bb45-ee07-47e1-903d-fbf67104800b"}]} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 11:00:32.761137 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=6 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 11:00:32.767055 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-b4fdff95-5985-4455-b99c-658a2fd79ebf req-76560c4e-0d83-42e0-9424-85a8b1fd9a68 service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 11:00:32.767498 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-b4fdff95-5985-4455-b99c-658a2fd79ebf req-76560c4e-0d83-42e0-9424-85a8b1fd9a68 service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 11:00:32.778498 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.compute.server_external_events [req-b4fdff95-5985-4455-b99c-658a2fd79ebf req-76560c4e-0d83-42e0-9424-85a8b1fd9a68 service nova] Creating event network-vif-plugged:8303bb45-ee07-47e1-903d-fbf67104800b for instance 0e974eb5-69fa-4c06-834b-0d0cac61e5fc on hv-cinder-84980 Jul 21 11:00:32.783693 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [req-b4fdff95-5985-4455-b99c-658a2fd79ebf req-76560c4e-0d83-42e0-9424-85a8b1fd9a68 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030224 Jul 21 11:00:32.784273 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 604/1201] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 21 11:00:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 11:00:33.216252 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-05ec04cf-45d5-4b8c-adf1-2530ab505ea4 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 11:00:33.216856 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-05ec04cf-45d5-4b8c-adf1-2530ab505ea4 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] [instance: 0e974eb5-69fa-4c06-834b-0d0cac61e5fc] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 11:00:33.219603 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 11:00:33.224308 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-05ec04cf-45d5-4b8c-adf1-2530ab505ea4 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 11:00:33.224925 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-05ec04cf-45d5-4b8c-adf1-2530ab505ea4 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 11:00:33.225776 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-05ec04cf-45d5-4b8c-adf1-2530ab505ea4 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 11:00:33.226204 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-05ec04cf-45d5-4b8c-adf1-2530ab505ea4 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 11:00:33.364338 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-05ec04cf-45d5-4b8c-adf1-2530ab505ea4 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0aebc4614c448bdb77fb167d4ae3de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99e5deac07a429c9c771ef41d278a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 11:00:33.372338 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-05ec04cf-45d5-4b8c-adf1-2530ab505ea4 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] 10.222.0.48 "GET /compute/v2.1/servers/0e974eb5-69fa-4c06-834b-0d0cac61e5fc" status: 200 len: 1265 microversion: 2.1 time: 0.159973 Jul 21 11:00:33.372896 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 598/1202] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 11:00:33 2022] GET /compute/v2.1/servers/0e974eb5-69fa-4c06-834b-0d0cac61e5fc => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 11:00:34.391118 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-42a5fd77-8630-4bbf-8069-0fa8417fcd97 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 11:00:34.391814 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-42a5fd77-8630-4bbf-8069-0fa8417fcd97 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] [instance: 0e974eb5-69fa-4c06-834b-0d0cac61e5fc] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 11:00:34.398124 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-42a5fd77-8630-4bbf-8069-0fa8417fcd97 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 11:00:34.398603 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-42a5fd77-8630-4bbf-8069-0fa8417fcd97 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 11:00:34.399375 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-42a5fd77-8630-4bbf-8069-0fa8417fcd97 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 11:00:34.399785 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-42a5fd77-8630-4bbf-8069-0fa8417fcd97 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 11:00:34.542784 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-42a5fd77-8630-4bbf-8069-0fa8417fcd97 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0aebc4614c448bdb77fb167d4ae3de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99e5deac07a429c9c771ef41d278a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 11:00:34.551351 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-42a5fd77-8630-4bbf-8069-0fa8417fcd97 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] 10.222.0.48 "GET /compute/v2.1/servers/0e974eb5-69fa-4c06-834b-0d0cac61e5fc" status: 200 len: 1452 microversion: 2.1 time: 0.165304 Jul 21 11:00:34.555823 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 605/1203] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 11:00:34 2022] GET /compute/v2.1/servers/0e974eb5-69fa-4c06-834b-0d0cac61e5fc => generated 1452 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 11:00:34.568185 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-2c1986b0-3291-49ae-b872-8e5681c49850 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 11:00:34.568773 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-2c1986b0-3291-49ae-b872-8e5681c49850 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] [instance: 0e974eb5-69fa-4c06-834b-0d0cac61e5fc] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 11:00:34.575339 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-2c1986b0-3291-49ae-b872-8e5681c49850 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 11:00:34.575777 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-2c1986b0-3291-49ae-b872-8e5681c49850 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 11:00:34.576561 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-2c1986b0-3291-49ae-b872-8e5681c49850 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 11:00:34.577110 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-2c1986b0-3291-49ae-b872-8e5681c49850 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 11:00:34.712338 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-2c1986b0-3291-49ae-b872-8e5681c49850 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0aebc4614c448bdb77fb167d4ae3de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99e5deac07a429c9c771ef41d278a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 11:00:34.720295 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-2c1986b0-3291-49ae-b872-8e5681c49850 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] 10.222.0.48 "GET /compute/v2.1/servers/0e974eb5-69fa-4c06-834b-0d0cac61e5fc" status: 200 len: 1452 microversion: 2.1 time: 0.155831 Jul 21 11:00:34.720797 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 599/1204] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 11:00:34 2022] GET /compute/v2.1/servers/0e974eb5-69fa-4c06-834b-0d0cac61e5fc => generated 1452 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 11:00:36.634992 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [req-178f74b3-1609-40a2-ba71-969f1d49488c req-ca869f54-999a-4501-adf1-3440ac6e72a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e974eb5-69fa-4c06-834b-0d0cac61e5fc", "tag": "8303bb45-ee07-47e1-903d-fbf67104800b"}]} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 11:00:36.644391 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-178f74b3-1609-40a2-ba71-969f1d49488c req-ca869f54-999a-4501-adf1-3440ac6e72a7 service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 11:00:36.645207 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-178f74b3-1609-40a2-ba71-969f1d49488c req-ca869f54-999a-4501-adf1-3440ac6e72a7 service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 11:00:36.656344 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.compute.server_external_events [req-178f74b3-1609-40a2-ba71-969f1d49488c req-ca869f54-999a-4501-adf1-3440ac6e72a7 service nova] Creating event network-changed:8303bb45-ee07-47e1-903d-fbf67104800b for instance 0e974eb5-69fa-4c06-834b-0d0cac61e5fc on hv-cinder-84980 Jul 21 11:00:36.661317 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [req-178f74b3-1609-40a2-ba71-969f1d49488c req-ca869f54-999a-4501-adf1-3440ac6e72a7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030702 Jul 21 11:00:36.661919 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 606/1205] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 21 11:00:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 11:01:25.636691 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 11:01:25.637448 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Thu Jul 21 11:01:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 11:02:08.262594 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_api:SELECT=5 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 11:02:08.266848 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-207213b6-3a22-40ab-8995-ffe0f7cc5174 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 11:02:08.267373 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG dbcounter [-] [124867] Writing DB stats nova_cell1:SELECT=12 {{(pid=124867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 11:02:08.267493 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-207213b6-3a22-40ab-8995-ffe0f7cc5174 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] [instance: 0e974eb5-69fa-4c06-834b-0d0cac61e5fc] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 11:02:08.269906 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_api:SELECT=3 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 11:02:08.270728 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG dbcounter [-] [124868] Writing DB stats nova_cell1:SELECT=20 {{(pid=124868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 11:02:08.279962 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [req-d808b28d-a2e1-4d8c-b33e-0ad60697d5af req-34323f94-6367-43e8-9a39-bd31d91d8b09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e974eb5-69fa-4c06-834b-0d0cac61e5fc", "tag": "8303bb45-ee07-47e1-903d-fbf67104800b"}]} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 11:02:08.280124 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-207213b6-3a22-40ab-8995-ffe0f7cc5174 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 11:02:08.280124 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-207213b6-3a22-40ab-8995-ffe0f7cc5174 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 11:02:08.280124 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-207213b6-3a22-40ab-8995-ffe0f7cc5174 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 11:02:08.280124 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-207213b6-3a22-40ab-8995-ffe0f7cc5174 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 11:02:08.280562 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-d808b28d-a2e1-4d8c-b33e-0ad60697d5af req-34323f94-6367-43e8-9a39-bd31d91d8b09 service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 11:02:08.280863 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-d808b28d-a2e1-4d8c-b33e-0ad60697d5af req-34323f94-6367-43e8-9a39-bd31d91d8b09 service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 11:02:08.292010 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.compute.server_external_events [req-d808b28d-a2e1-4d8c-b33e-0ad60697d5af req-34323f94-6367-43e8-9a39-bd31d91d8b09 service nova] Creating event network-changed:8303bb45-ee07-47e1-903d-fbf67104800b for instance 0e974eb5-69fa-4c06-834b-0d0cac61e5fc on hv-cinder-84980 Jul 21 11:02:08.297277 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [req-d808b28d-a2e1-4d8c-b33e-0ad60697d5af req-34323f94-6367-43e8-9a39-bd31d91d8b09 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036371 Jul 21 11:02:08.298126 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 607/1206] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 21 11:02:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 11:02:08.304079 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-207213b6-3a22-40ab-8995-ffe0f7cc5174 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] [instance: 0e974eb5-69fa-4c06-834b-0d0cac61e5fc] Going to try to terminate instance {{(pid=124868) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 11:02:08.551210 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-207213b6-3a22-40ab-8995-ffe0f7cc5174 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] 10.222.0.48 "DELETE /compute/v2.1/servers/0e974eb5-69fa-4c06-834b-0d0cac61e5fc" status: 204 len: 0 microversion: 2.1 time: 0.292366 Jul 21 11:02:08.551936 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 600/1207] 10.222.0.48 () {58 vars in 1238 bytes} [Thu Jul 21 11:02:08 2022] DELETE /compute/v2.1/servers/0e974eb5-69fa-4c06-834b-0d0cac61e5fc => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 11:02:08.561267 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-459b2b10-a4f2-495c-b26a-9f61adab3c4e tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 11:02:08.563156 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-459b2b10-a4f2-495c-b26a-9f61adab3c4e tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] [instance: 0e974eb5-69fa-4c06-834b-0d0cac61e5fc] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 11:02:08.570195 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-459b2b10-a4f2-495c-b26a-9f61adab3c4e tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 11:02:08.570674 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-459b2b10-a4f2-495c-b26a-9f61adab3c4e tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 11:02:08.571444 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-459b2b10-a4f2-495c-b26a-9f61adab3c4e tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 11:02:08.571879 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-459b2b10-a4f2-495c-b26a-9f61adab3c4e tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 11:02:08.834103 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-459b2b10-a4f2-495c-b26a-9f61adab3c4e tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0aebc4614c448bdb77fb167d4ae3de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99e5deac07a429c9c771ef41d278a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 11:02:08.842134 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-459b2b10-a4f2-495c-b26a-9f61adab3c4e tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] 10.222.0.48 "GET /compute/v2.1/servers/0e974eb5-69fa-4c06-834b-0d0cac61e5fc" status: 200 len: 1576 microversion: 2.1 time: 0.285370 Jul 21 11:02:08.842747 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 608/1208] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 11:02:08 2022] GET /compute/v2.1/servers/0e974eb5-69fa-4c06-834b-0d0cac61e5fc => generated 1576 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 11:02:09.861259 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-ba8c1dab-ad44-460c-b228-0d8fbbb64938 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 11:02:09.862694 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-ba8c1dab-ad44-460c-b228-0d8fbbb64938 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] [instance: 0e974eb5-69fa-4c06-834b-0d0cac61e5fc] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 11:02:09.869228 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ba8c1dab-ad44-460c-b228-0d8fbbb64938 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 11:02:09.869678 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ba8c1dab-ad44-460c-b228-0d8fbbb64938 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 11:02:09.870455 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ba8c1dab-ad44-460c-b228-0d8fbbb64938 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 11:02:09.870913 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-ba8c1dab-ad44-460c-b228-0d8fbbb64938 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 11:02:10.058692 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-ba8c1dab-ad44-460c-b228-0d8fbbb64938 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0aebc4614c448bdb77fb167d4ae3de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99e5deac07a429c9c771ef41d278a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 11:02:10.066575 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-ba8c1dab-ad44-460c-b228-0d8fbbb64938 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] 10.222.0.48 "GET /compute/v2.1/servers/0e974eb5-69fa-4c06-834b-0d0cac61e5fc" status: 200 len: 1576 microversion: 2.1 time: 0.209673 Jul 21 11:02:10.067134 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 601/1209] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 11:02:09 2022] GET /compute/v2.1/servers/0e974eb5-69fa-4c06-834b-0d0cac61e5fc => generated 1576 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 11:02:10.783574 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [req-7e9b8145-c8e6-4323-8729-b116139a31b3 req-5dbb6ca5-0b05-4a1d-8f6b-2d1e43d36540 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e974eb5-69fa-4c06-834b-0d0cac61e5fc", "name": "network-vif-deleted", "tag": "8303bb45-ee07-47e1-903d-fbf67104800b"}]} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 11:02:10.789895 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-7e9b8145-c8e6-4323-8729-b116139a31b3 req-5dbb6ca5-0b05-4a1d-8f6b-2d1e43d36540 service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 11:02:10.789895 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-7e9b8145-c8e6-4323-8729-b116139a31b3 req-5dbb6ca5-0b05-4a1d-8f6b-2d1e43d36540 service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 11:02:10.801853 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.compute.server_external_events [req-7e9b8145-c8e6-4323-8729-b116139a31b3 req-5dbb6ca5-0b05-4a1d-8f6b-2d1e43d36540 service nova] Creating event network-vif-deleted:8303bb45-ee07-47e1-903d-fbf67104800b for instance 0e974eb5-69fa-4c06-834b-0d0cac61e5fc on hv-cinder-84980 Jul 21 11:02:10.806556 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [req-7e9b8145-c8e6-4323-8729-b116139a31b3 req-5dbb6ca5-0b05-4a1d-8f6b-2d1e43d36540 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030361 Jul 21 11:02:10.807152 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 609/1210] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 21 11:02:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 11:02:11.084465 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-19a9b128-656f-41ed-857d-612f740c8463 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 11:02:11.085077 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-19a9b128-656f-41ed-857d-612f740c8463 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] [instance: 0e974eb5-69fa-4c06-834b-0d0cac61e5fc] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 11:02:11.091744 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-19a9b128-656f-41ed-857d-612f740c8463 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 11:02:11.092208 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-19a9b128-656f-41ed-857d-612f740c8463 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 11:02:11.092960 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-19a9b128-656f-41ed-857d-612f740c8463 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 11:02:11.093393 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-19a9b128-656f-41ed-857d-612f740c8463 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 11:02:11.159787 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-19a9b128-656f-41ed-857d-612f740c8463 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0aebc4614c448bdb77fb167d4ae3de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99e5deac07a429c9c771ef41d278a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 11:02:11.167681 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-19a9b128-656f-41ed-857d-612f740c8463 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] 10.222.0.48 "GET /compute/v2.1/servers/0e974eb5-69fa-4c06-834b-0d0cac61e5fc" status: 200 len: 1225 microversion: 2.1 time: 0.087768 Jul 21 11:02:11.168425 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 602/1211] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 11:02:11 2022] GET /compute/v2.1/servers/0e974eb5-69fa-4c06-834b-0d0cac61e5fc => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 11:02:12.186191 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-505c6781-8adc-4a5a-afc9-dc4632ce57fb tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 11:02:12.186932 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-505c6781-8adc-4a5a-afc9-dc4632ce57fb tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] [instance: 0e974eb5-69fa-4c06-834b-0d0cac61e5fc] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 11:02:12.194835 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-505c6781-8adc-4a5a-afc9-dc4632ce57fb tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 11:02:12.195277 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-505c6781-8adc-4a5a-afc9-dc4632ce57fb tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 11:02:12.196046 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-505c6781-8adc-4a5a-afc9-dc4632ce57fb tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 11:02:12.196475 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-505c6781-8adc-4a5a-afc9-dc4632ce57fb tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 11:02:12.210882 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.wsgi [None req-505c6781-8adc-4a5a-afc9-dc4632ce57fb tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] HTTP exception thrown: Instance 0e974eb5-69fa-4c06-834b-0d0cac61e5fc could not be found. Jul 21 11:02:12.220539 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-505c6781-8adc-4a5a-afc9-dc4632ce57fb tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Request method failure captured: Jul 21 11:02:12.220539 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: request: GET /compute/v2.1/servers/0e974eb5-69fa-4c06-834b-0d0cac61e5fc HTTP/1.1 Jul 21 11:02:12.220539 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Accept: application/json Jul 21 11:02:12.220539 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Accept-Encoding: identity Jul 21 11:02:12.220539 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Connection: close Jul 21 11:02:12.220539 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Content-Length: 0 Jul 21 11:02:12.220539 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Content-Type: application/json Jul 21 11:02:12.220539 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Host: 10.222.0.48 Jul 21 11:02:12.220539 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Openstack-System-Scope: None Jul 21 11:02:12.220539 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: User-Agent: python-urllib3/1.26.9 Jul 21 11:02:12.220539 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Auth-Token: gAAAAABi2TCh3XzGM6jHijsg2hWzsJtwhtPnT2DyLW3wj2wlseyOVcn9mJer3DWoWxAOIadJ7x8wrD-LlWyxmZATMSsj1DOFeE18t8k33-evamXfmTyFWGbKSF16rQXRD4TUUyEmjx78KLNIfiX7uISqDUHRNZrxF8FfpjGPXZ5pUb-KQPlQ-8s Jul 21 11:02:12.220539 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Domain-Id: None Jul 21 11:02:12.220539 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Domain-Name: None Jul 21 11:02:12.220539 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Identity-Status: Confirmed Jul 21 11:02:12.220539 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Is-Admin-Project: True Jul 21 11:02:12.220539 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Project-Domain-Id: default Jul 21 11:02:12.220539 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Project-Domain-Name: Default Jul 21 11:02:12.220539 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Project-Id: c99e5deac07a429c9c771ef41d278a46 Jul 21 11:02:12.220539 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Project-Name: tempest-TestVolumeBootPattern-786894644 Jul 21 11:02:12.220539 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Role: reader,member Jul 21 11:02:12.220539 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Roles: reader,member Jul 21 11:02:12.222377 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c99e5deac07a429c9c771ef41d278a46"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c99e5deac07a429c9c771ef41d278a46"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c99e5deac07a429c9c771ef41d278a46"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c99e5deac07a429c9c771ef41d278a46"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] Jul 21 11:02:12.222377 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Tenant: tempest-TestVolumeBootPattern-786894644 Jul 21 11:02:12.222377 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Tenant-Id: c99e5deac07a429c9c771ef41d278a46 Jul 21 11:02:12.222377 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Tenant-Name: tempest-TestVolumeBootPattern-786894644 Jul 21 11:02:12.222377 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User: tempest-TestVolumeBootPattern-786894644-project Jul 21 11:02:12.222377 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User-Domain-Id: default Jul 21 11:02:12.222377 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User-Domain-Name: Default Jul 21 11:02:12.222377 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User-Id: a0aebc4614c448bdb77fb167d4ae3de1 Jul 21 11:02:12.222377 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User-Name: tempest-TestVolumeBootPattern-786894644-project Jul 21 11:02:12.222377 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: method: > Jul 21 11:02:12.222377 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: exception: Instance 0e974eb5-69fa-4c06-834b-0d0cac61e5fc could not be found. Jul 21 11:02:12.222377 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: action_args: {'id': '0e974eb5-69fa-4c06-834b-0d0cac61e5fc'} Jul 21 11:02:12.223535 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 11:02:12.223535 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 11:02:12.223535 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 11:02:12.223535 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 11:02:12.223535 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 11:02:12.223535 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 11:02:12.223535 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 11:02:12.223535 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 11:02:12.223535 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 11:02:12.223535 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 11:02:12.223535 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e974eb5-69fa-4c06-834b-0d0cac61e5fc could not be found. Jul 21 11:02:12.223535 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 11:02:12.223535 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 11:02:12.223535 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 11:02:12.223535 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 11:02:12.223535 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 11:02:12.223535 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 11:02:12.223535 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 11:02:12.223535 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 11:02:12.223535 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 11:02:12.225214 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 11:02:12.225214 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 11:02:12.225214 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 11:02:12.225214 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 11:02:12.225214 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 11:02:12.225214 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 11:02:12.225214 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 11:02:12.225214 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e974eb5-69fa-4c06-834b-0d0cac61e5fc could not be found. Jul 21 11:02:12.225214 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 11:02:12.225214 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 11:02:12.225214 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 11:02:12.225214 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 11:02:12.225214 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 11:02:12.225214 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 11:02:12.225214 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 11:02:12.225214 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 11:02:12.225214 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e974eb5-69fa-4c06-834b-0d0cac61e5fc could not be found. Jul 21 11:02:12.225214 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 11:02:12.227377 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-505c6781-8adc-4a5a-afc9-dc4632ce57fb tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Returning 404 to user: Instance 0e974eb5-69fa-4c06-834b-0d0cac61e5fc could not be found. {{(pid=124867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 11:02:12.227377 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-505c6781-8adc-4a5a-afc9-dc4632ce57fb tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] 10.222.0.48 "GET /compute/v2.1/servers/0e974eb5-69fa-4c06-834b-0d0cac61e5fc" status: 404 len: 111 microversion: 2.1 time: 0.032370 Jul 21 11:02:12.227377 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 610/1212] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 11:02:12 2022] GET /compute/v2.1/servers/0e974eb5-69fa-4c06-834b-0d0cac61e5fc => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 11:02:15.733163 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [req-5f09e6e3-d983-4005-a950-3b9b2257a30c req-80b7f4ee-1b2a-47a5-9f11-1a7d5471415c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20b5ce2d-dd53-4957-839f-b674794f29ee", "tag": "297932c9-c2bf-4d0d-a5e4-14259e6cc191"}]} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 11:02:15.735711 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-4b207587-158e-40c3-ac21-025dc54fcc5b tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 11:02:15.736284 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-4b207587-158e-40c3-ac21-025dc54fcc5b tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] [instance: 20b5ce2d-dd53-4957-839f-b674794f29ee] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 11:02:15.743525 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4b207587-158e-40c3-ac21-025dc54fcc5b tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 11:02:15.744240 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4b207587-158e-40c3-ac21-025dc54fcc5b tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 11:02:15.745021 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4b207587-158e-40c3-ac21-025dc54fcc5b tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 11:02:15.745457 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-4b207587-158e-40c3-ac21-025dc54fcc5b tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 11:02:15.747643 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-5f09e6e3-d983-4005-a950-3b9b2257a30c req-80b7f4ee-1b2a-47a5-9f11-1a7d5471415c service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 11:02:15.748024 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-5f09e6e3-d983-4005-a950-3b9b2257a30c req-80b7f4ee-1b2a-47a5-9f11-1a7d5471415c service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 11:02:15.762952 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.compute.server_external_events [req-5f09e6e3-d983-4005-a950-3b9b2257a30c req-80b7f4ee-1b2a-47a5-9f11-1a7d5471415c service nova] Creating event network-changed:297932c9-c2bf-4d0d-a5e4-14259e6cc191 for instance 20b5ce2d-dd53-4957-839f-b674794f29ee on hv-cinder-84980 Jul 21 11:02:15.767859 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [req-5f09e6e3-d983-4005-a950-3b9b2257a30c req-80b7f4ee-1b2a-47a5-9f11-1a7d5471415c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038264 Jul 21 11:02:15.768447 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 611/1213] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 21 11:02:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 11:02:15.776243 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-4b207587-158e-40c3-ac21-025dc54fcc5b tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] [instance: 20b5ce2d-dd53-4957-839f-b674794f29ee] Going to try to terminate instance {{(pid=124868) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 11:02:16.006743 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-4b207587-158e-40c3-ac21-025dc54fcc5b tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] 10.222.0.48 "DELETE /compute/v2.1/servers/20b5ce2d-dd53-4957-839f-b674794f29ee" status: 204 len: 0 microversion: 2.1 time: 0.280883 Jul 21 11:02:16.010967 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 603/1214] 10.222.0.48 () {58 vars in 1238 bytes} [Thu Jul 21 11:02:15 2022] DELETE /compute/v2.1/servers/20b5ce2d-dd53-4957-839f-b674794f29ee => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 11:02:16.016412 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-0b075db3-40df-4d16-99ae-9aa76c5866ec tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 11:02:16.017116 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-0b075db3-40df-4d16-99ae-9aa76c5866ec tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] [instance: 20b5ce2d-dd53-4957-839f-b674794f29ee] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 11:02:16.024086 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0b075db3-40df-4d16-99ae-9aa76c5866ec tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 11:02:16.024552 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0b075db3-40df-4d16-99ae-9aa76c5866ec tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 11:02:16.025314 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0b075db3-40df-4d16-99ae-9aa76c5866ec tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 11:02:16.025760 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-0b075db3-40df-4d16-99ae-9aa76c5866ec tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 11:02:16.175425 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.policy [None req-0b075db3-40df-4d16-99ae-9aa76c5866ec tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0aebc4614c448bdb77fb167d4ae3de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99e5deac07a429c9c771ef41d278a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124867) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 11:02:16.183624 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-0b075db3-40df-4d16-99ae-9aa76c5866ec tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] 10.222.0.48 "GET /compute/v2.1/servers/20b5ce2d-dd53-4957-839f-b674794f29ee" status: 200 len: 1576 microversion: 2.1 time: 0.171388 Jul 21 11:02:16.184403 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 612/1215] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 11:02:16 2022] GET /compute/v2.1/servers/20b5ce2d-dd53-4957-839f-b674794f29ee => generated 1576 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 11:02:17.203200 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-de4dbbf5-0037-4df9-9621-221c463bd276 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 11:02:17.204544 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-de4dbbf5-0037-4df9-9621-221c463bd276 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] [instance: 20b5ce2d-dd53-4957-839f-b674794f29ee] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 11:02:17.211399 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-de4dbbf5-0037-4df9-9621-221c463bd276 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 11:02:17.211850 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-de4dbbf5-0037-4df9-9621-221c463bd276 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 11:02:17.213292 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-de4dbbf5-0037-4df9-9621-221c463bd276 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 11:02:17.213731 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-de4dbbf5-0037-4df9-9621-221c463bd276 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 11:02:17.348346 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-de4dbbf5-0037-4df9-9621-221c463bd276 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0aebc4614c448bdb77fb167d4ae3de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99e5deac07a429c9c771ef41d278a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 11:02:17.356103 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-de4dbbf5-0037-4df9-9621-221c463bd276 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] 10.222.0.48 "GET /compute/v2.1/servers/20b5ce2d-dd53-4957-839f-b674794f29ee" status: 200 len: 1576 microversion: 2.1 time: 0.157913 Jul 21 11:02:17.356677 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 604/1216] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 11:02:17 2022] GET /compute/v2.1/servers/20b5ce2d-dd53-4957-839f-b674794f29ee => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 11:02:18.145740 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [req-b528b23b-e8da-44a0-bb99-229b0df3bc0a req-0e49e667-499a-4c72-b830-e09f44f976ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20b5ce2d-dd53-4957-839f-b674794f29ee", "name": "network-vif-deleted", "tag": "297932c9-c2bf-4d0d-a5e4-14259e6cc191"}]} {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 11:02:18.158710 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-b528b23b-e8da-44a0-bb99-229b0df3bc0a req-0e49e667-499a-4c72-b830-e09f44f976ef service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 11:02:18.159484 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [req-b528b23b-e8da-44a0-bb99-229b0df3bc0a req-0e49e667-499a-4c72-b830-e09f44f976ef service nova] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 11:02:18.175703 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.compute.server_external_events [req-b528b23b-e8da-44a0-bb99-229b0df3bc0a req-0e49e667-499a-4c72-b830-e09f44f976ef service nova] Creating event network-vif-deleted:297932c9-c2bf-4d0d-a5e4-14259e6cc191 for instance 20b5ce2d-dd53-4957-839f-b674794f29ee on hv-cinder-84980 Jul 21 11:02:18.181244 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [req-b528b23b-e8da-44a0-bb99-229b0df3bc0a req-0e49e667-499a-4c72-b830-e09f44f976ef service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039468 Jul 21 11:02:18.184219 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 613/1217] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 21 11:02:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 11:02:18.373441 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-2f12fe39-cd4e-4ea5-8203-0f853887ae62 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 11:02:18.374066 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-2f12fe39-cd4e-4ea5-8203-0f853887ae62 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] [instance: 20b5ce2d-dd53-4957-839f-b674794f29ee] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 11:02:18.380594 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-2f12fe39-cd4e-4ea5-8203-0f853887ae62 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 11:02:18.381041 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-2f12fe39-cd4e-4ea5-8203-0f853887ae62 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 11:02:18.381798 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-2f12fe39-cd4e-4ea5-8203-0f853887ae62 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 11:02:18.382231 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-2f12fe39-cd4e-4ea5-8203-0f853887ae62 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 11:02:18.444029 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.policy [None req-2f12fe39-cd4e-4ea5-8203-0f853887ae62 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0aebc4614c448bdb77fb167d4ae3de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c99e5deac07a429c9c771ef41d278a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124868) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 11:02:18.451908 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-2f12fe39-cd4e-4ea5-8203-0f853887ae62 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] 10.222.0.48 "GET /compute/v2.1/servers/20b5ce2d-dd53-4957-839f-b674794f29ee" status: 200 len: 1224 microversion: 2.1 time: 0.082392 Jul 21 11:02:18.452609 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 605/1218] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 11:02:18 2022] GET /compute/v2.1/servers/20b5ce2d-dd53-4957-839f-b674794f29ee => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 11:02:19.470352 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-c77a49bf-a537-4967-a681-7e8fedae01ba tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 11:02:19.471077 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-c77a49bf-a537-4967-a681-7e8fedae01ba tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] [instance: 20b5ce2d-dd53-4957-839f-b674794f29ee] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 11:02:19.477655 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c77a49bf-a537-4967-a681-7e8fedae01ba tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 11:02:19.478098 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c77a49bf-a537-4967-a681-7e8fedae01ba tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 11:02:19.478919 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c77a49bf-a537-4967-a681-7e8fedae01ba tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 11:02:19.479354 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-c77a49bf-a537-4967-a681-7e8fedae01ba tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 11:02:19.493058 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.wsgi [None req-c77a49bf-a537-4967-a681-7e8fedae01ba tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] HTTP exception thrown: Instance 20b5ce2d-dd53-4957-839f-b674794f29ee could not be found. Jul 21 11:02:19.494759 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-c77a49bf-a537-4967-a681-7e8fedae01ba tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Request method failure captured: Jul 21 11:02:19.494759 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: request: GET /compute/v2.1/servers/20b5ce2d-dd53-4957-839f-b674794f29ee HTTP/1.1 Jul 21 11:02:19.494759 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Accept: application/json Jul 21 11:02:19.494759 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Accept-Encoding: identity Jul 21 11:02:19.494759 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Connection: close Jul 21 11:02:19.494759 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Content-Length: 0 Jul 21 11:02:19.494759 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Content-Type: application/json Jul 21 11:02:19.494759 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Host: 10.222.0.48 Jul 21 11:02:19.494759 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Openstack-System-Scope: None Jul 21 11:02:19.494759 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: User-Agent: python-urllib3/1.26.9 Jul 21 11:02:19.494759 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Auth-Token: gAAAAABi2TCh3XzGM6jHijsg2hWzsJtwhtPnT2DyLW3wj2wlseyOVcn9mJer3DWoWxAOIadJ7x8wrD-LlWyxmZATMSsj1DOFeE18t8k33-evamXfmTyFWGbKSF16rQXRD4TUUyEmjx78KLNIfiX7uISqDUHRNZrxF8FfpjGPXZ5pUb-KQPlQ-8s Jul 21 11:02:19.494759 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Domain-Id: None Jul 21 11:02:19.494759 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Domain-Name: None Jul 21 11:02:19.494759 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Identity-Status: Confirmed Jul 21 11:02:19.494759 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Is-Admin-Project: True Jul 21 11:02:19.494759 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Project-Domain-Id: default Jul 21 11:02:19.494759 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Project-Domain-Name: Default Jul 21 11:02:19.494759 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Project-Id: c99e5deac07a429c9c771ef41d278a46 Jul 21 11:02:19.494759 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Project-Name: tempest-TestVolumeBootPattern-786894644 Jul 21 11:02:19.494759 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Role: reader,member Jul 21 11:02:19.494759 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Roles: reader,member Jul 21 11:02:19.502194 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c99e5deac07a429c9c771ef41d278a46"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c99e5deac07a429c9c771ef41d278a46"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c99e5deac07a429c9c771ef41d278a46"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c99e5deac07a429c9c771ef41d278a46"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] Jul 21 11:02:19.502194 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Tenant: tempest-TestVolumeBootPattern-786894644 Jul 21 11:02:19.502194 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Tenant-Id: c99e5deac07a429c9c771ef41d278a46 Jul 21 11:02:19.502194 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Tenant-Name: tempest-TestVolumeBootPattern-786894644 Jul 21 11:02:19.502194 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User: tempest-TestVolumeBootPattern-786894644-project Jul 21 11:02:19.502194 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User-Domain-Id: default Jul 21 11:02:19.502194 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User-Domain-Name: Default Jul 21 11:02:19.502194 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User-Id: a0aebc4614c448bdb77fb167d4ae3de1 Jul 21 11:02:19.502194 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User-Name: tempest-TestVolumeBootPattern-786894644-project Jul 21 11:02:19.502194 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: method: > Jul 21 11:02:19.502194 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: exception: Instance 20b5ce2d-dd53-4957-839f-b674794f29ee could not be found. Jul 21 11:02:19.502194 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: action_args: {'id': '20b5ce2d-dd53-4957-839f-b674794f29ee'} Jul 21 11:02:19.503786 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 11:02:19.503786 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 11:02:19.503786 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 11:02:19.503786 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 11:02:19.503786 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 11:02:19.503786 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 11:02:19.503786 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 11:02:19.503786 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 11:02:19.503786 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 11:02:19.503786 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 11:02:19.503786 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20b5ce2d-dd53-4957-839f-b674794f29ee could not be found. Jul 21 11:02:19.503786 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 11:02:19.503786 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 11:02:19.503786 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 11:02:19.503786 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 11:02:19.503786 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 11:02:19.503786 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 11:02:19.503786 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 11:02:19.503786 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 11:02:19.503786 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 11:02:19.506077 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 11:02:19.506077 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 11:02:19.506077 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 11:02:19.506077 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 11:02:19.506077 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 11:02:19.506077 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 11:02:19.506077 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 11:02:19.506077 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20b5ce2d-dd53-4957-839f-b674794f29ee could not be found. Jul 21 11:02:19.506077 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 11:02:19.506077 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 11:02:19.506077 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 11:02:19.506077 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 11:02:19.506077 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 11:02:19.506077 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 11:02:19.506077 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 11:02:19.506077 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 11:02:19.506077 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20b5ce2d-dd53-4957-839f-b674794f29ee could not be found. Jul 21 11:02:19.506077 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 11:02:19.507756 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-c77a49bf-a537-4967-a681-7e8fedae01ba tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Returning 404 to user: Instance 20b5ce2d-dd53-4957-839f-b674794f29ee could not be found. {{(pid=124867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 11:02:19.507756 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-c77a49bf-a537-4967-a681-7e8fedae01ba tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] 10.222.0.48 "GET /compute/v2.1/servers/20b5ce2d-dd53-4957-839f-b674794f29ee" status: 404 len: 111 microversion: 2.1 time: 0.031671 Jul 21 11:02:19.507756 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 614/1219] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 11:02:19 2022] GET /compute/v2.1/servers/20b5ce2d-dd53-4957-839f-b674794f29ee => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 11:02:19.987529 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-d7dfbefe-838e-4ed3-b169-27d9bf18205e tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Calling method '>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 11:02:19.988039 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.compute.api [None req-d7dfbefe-838e-4ed3-b169-27d9bf18205e tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] [instance: 6ef47e35-a90e-4c42-9bbc-1e09a85d7d0e] Fetching instance by UUID {{(pid=124868) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 11:02:19.995341 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d7dfbefe-838e-4ed3-b169-27d9bf18205e tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 11:02:19.999460 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d7dfbefe-838e-4ed3-b169-27d9bf18205e tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 11:02:19.999460 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d7dfbefe-838e-4ed3-b169-27d9bf18205e tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 11:02:19.999460 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG oslo_concurrency.lockutils [None req-d7dfbefe-838e-4ed3-b169-27d9bf18205e tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 11:02:20.010226 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.wsgi [None req-d7dfbefe-838e-4ed3-b169-27d9bf18205e tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] HTTP exception thrown: Instance 6ef47e35-a90e-4c42-9bbc-1e09a85d7d0e could not be found. Jul 21 11:02:20.011918 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-d7dfbefe-838e-4ed3-b169-27d9bf18205e tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Request method failure captured: Jul 21 11:02:20.011918 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: request: DELETE /compute/v2.1/servers/6ef47e35-a90e-4c42-9bbc-1e09a85d7d0e HTTP/1.1 Jul 21 11:02:20.011918 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Accept: application/json Jul 21 11:02:20.011918 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Accept-Encoding: identity Jul 21 11:02:20.011918 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Connection: close Jul 21 11:02:20.011918 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Content-Length: 0 Jul 21 11:02:20.011918 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Content-Type: application/json Jul 21 11:02:20.011918 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Host: 10.222.0.48 Jul 21 11:02:20.011918 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Openstack-System-Scope: None Jul 21 11:02:20.011918 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: User-Agent: python-urllib3/1.26.9 Jul 21 11:02:20.011918 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Auth-Token: gAAAAABi2TCh3XzGM6jHijsg2hWzsJtwhtPnT2DyLW3wj2wlseyOVcn9mJer3DWoWxAOIadJ7x8wrD-LlWyxmZATMSsj1DOFeE18t8k33-evamXfmTyFWGbKSF16rQXRD4TUUyEmjx78KLNIfiX7uISqDUHRNZrxF8FfpjGPXZ5pUb-KQPlQ-8s Jul 21 11:02:20.011918 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Domain-Id: None Jul 21 11:02:20.011918 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Domain-Name: None Jul 21 11:02:20.011918 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Identity-Status: Confirmed Jul 21 11:02:20.011918 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Is-Admin-Project: True Jul 21 11:02:20.011918 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Domain-Id: default Jul 21 11:02:20.011918 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Domain-Name: Default Jul 21 11:02:20.011918 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Id: c99e5deac07a429c9c771ef41d278a46 Jul 21 11:02:20.011918 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Project-Name: tempest-TestVolumeBootPattern-786894644 Jul 21 11:02:20.011918 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Role: reader,member Jul 21 11:02:20.011918 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Roles: reader,member Jul 21 11:02:20.013680 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c99e5deac07a429c9c771ef41d278a46"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c99e5deac07a429c9c771ef41d278a46"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c99e5deac07a429c9c771ef41d278a46"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c99e5deac07a429c9c771ef41d278a46"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] Jul 21 11:02:20.013680 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Tenant: tempest-TestVolumeBootPattern-786894644 Jul 21 11:02:20.013680 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Tenant-Id: c99e5deac07a429c9c771ef41d278a46 Jul 21 11:02:20.013680 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-Tenant-Name: tempest-TestVolumeBootPattern-786894644 Jul 21 11:02:20.013680 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User: tempest-TestVolumeBootPattern-786894644-project Jul 21 11:02:20.013680 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Domain-Id: default Jul 21 11:02:20.013680 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Domain-Name: Default Jul 21 11:02:20.013680 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Id: a0aebc4614c448bdb77fb167d4ae3de1 Jul 21 11:02:20.013680 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: X-User-Name: tempest-TestVolumeBootPattern-786894644-project Jul 21 11:02:20.013680 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: method: > Jul 21 11:02:20.013680 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: exception: Instance 6ef47e35-a90e-4c42-9bbc-1e09a85d7d0e could not be found. Jul 21 11:02:20.013680 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: action_args: {'id': '6ef47e35-a90e-4c42-9bbc-1e09a85d7d0e'} Jul 21 11:02:20.014676 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 11:02:20.014676 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 11:02:20.014676 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 11:02:20.014676 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 11:02:20.014676 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 11:02:20.014676 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 11:02:20.014676 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 11:02:20.014676 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 11:02:20.014676 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 11:02:20.014676 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 11:02:20.014676 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ef47e35-a90e-4c42-9bbc-1e09a85d7d0e could not be found. Jul 21 11:02:20.014676 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 11:02:20.014676 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 11:02:20.014676 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 11:02:20.014676 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 11:02:20.014676 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 11:02:20.014676 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 11:02:20.014676 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 11:02:20.014676 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 11:02:20.014676 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 11:02:20.016234 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 11:02:20.016234 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 21 11:02:20.016234 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 21 11:02:20.016234 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 21 11:02:20.016234 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 21 11:02:20.016234 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 11:02:20.016234 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 11:02:20.016234 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 11:02:20.016234 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 11:02:20.016234 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ef47e35-a90e-4c42-9bbc-1e09a85d7d0e could not be found. Jul 21 11:02:20.016234 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 11:02:20.016234 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 11:02:20.016234 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 11:02:20.016234 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 11:02:20.016234 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 11:02:20.016234 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 11:02:20.016234 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 11:02:20.016234 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 11:02:20.016234 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ef47e35-a90e-4c42-9bbc-1e09a85d7d0e could not be found. Jul 21 11:02:20.016234 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: ERROR nova.api.openstack.wsgi Jul 21 11:02:20.017779 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-d7dfbefe-838e-4ed3-b169-27d9bf18205e tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Returning 404 to user: Instance 6ef47e35-a90e-4c42-9bbc-1e09a85d7d0e could not be found. {{(pid=124868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 11:02:20.017779 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-d7dfbefe-838e-4ed3-b169-27d9bf18205e tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] 10.222.0.48 "DELETE /compute/v2.1/servers/6ef47e35-a90e-4c42-9bbc-1e09a85d7d0e" status: 404 len: 111 microversion: 2.1 time: 0.029607 Jul 21 11:02:20.017779 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 606/1220] 10.222.0.48 () {58 vars in 1238 bytes} [Thu Jul 21 11:02:19 2022] DELETE /compute/v2.1/servers/6ef47e35-a90e-4c42-9bbc-1e09a85d7d0e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 11:02:20.022342 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-989d13df-7e48-493b-8563-9051300c4866 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Calling method '>' {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 11:02:20.025906 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.compute.api [None req-989d13df-7e48-493b-8563-9051300c4866 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] [instance: 6ef47e35-a90e-4c42-9bbc-1e09a85d7d0e] Fetching instance by UUID {{(pid=124867) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 11:02:20.028843 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-989d13df-7e48-493b-8563-9051300c4866 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 11:02:20.029285 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-989d13df-7e48-493b-8563-9051300c4866 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 11:02:20.030032 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-989d13df-7e48-493b-8563-9051300c4866 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 11:02:20.030460 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG oslo_concurrency.lockutils [None req-989d13df-7e48-493b-8563-9051300c4866 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Lock "67214de0-1644-4a2c-ab6c-aaec113708cb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 11:02:20.044479 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.wsgi [None req-989d13df-7e48-493b-8563-9051300c4866 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] HTTP exception thrown: Instance 6ef47e35-a90e-4c42-9bbc-1e09a85d7d0e could not be found. Jul 21 11:02:20.045976 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-989d13df-7e48-493b-8563-9051300c4866 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Request method failure captured: Jul 21 11:02:20.045976 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: request: GET /compute/v2.1/servers/6ef47e35-a90e-4c42-9bbc-1e09a85d7d0e HTTP/1.1 Jul 21 11:02:20.045976 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Accept: application/json Jul 21 11:02:20.045976 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Accept-Encoding: identity Jul 21 11:02:20.045976 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Connection: close Jul 21 11:02:20.045976 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Content-Length: 0 Jul 21 11:02:20.045976 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Content-Type: application/json Jul 21 11:02:20.045976 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Host: 10.222.0.48 Jul 21 11:02:20.045976 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Openstack-System-Scope: None Jul 21 11:02:20.045976 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: User-Agent: python-urllib3/1.26.9 Jul 21 11:02:20.045976 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Auth-Token: gAAAAABi2TCh3XzGM6jHijsg2hWzsJtwhtPnT2DyLW3wj2wlseyOVcn9mJer3DWoWxAOIadJ7x8wrD-LlWyxmZATMSsj1DOFeE18t8k33-evamXfmTyFWGbKSF16rQXRD4TUUyEmjx78KLNIfiX7uISqDUHRNZrxF8FfpjGPXZ5pUb-KQPlQ-8s Jul 21 11:02:20.045976 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Domain-Id: None Jul 21 11:02:20.045976 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Domain-Name: None Jul 21 11:02:20.045976 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Identity-Status: Confirmed Jul 21 11:02:20.045976 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Is-Admin-Project: True Jul 21 11:02:20.045976 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Project-Domain-Id: default Jul 21 11:02:20.045976 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Project-Domain-Name: Default Jul 21 11:02:20.045976 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Project-Id: c99e5deac07a429c9c771ef41d278a46 Jul 21 11:02:20.045976 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Project-Name: tempest-TestVolumeBootPattern-786894644 Jul 21 11:02:20.045976 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Role: reader,member Jul 21 11:02:20.045976 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Roles: reader,member Jul 21 11:02:20.047743 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c99e5deac07a429c9c771ef41d278a46"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c99e5deac07a429c9c771ef41d278a46"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c99e5deac07a429c9c771ef41d278a46"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c99e5deac07a429c9c771ef41d278a46"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] Jul 21 11:02:20.047743 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Tenant: tempest-TestVolumeBootPattern-786894644 Jul 21 11:02:20.047743 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Tenant-Id: c99e5deac07a429c9c771ef41d278a46 Jul 21 11:02:20.047743 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-Tenant-Name: tempest-TestVolumeBootPattern-786894644 Jul 21 11:02:20.047743 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User: tempest-TestVolumeBootPattern-786894644-project Jul 21 11:02:20.047743 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User-Domain-Id: default Jul 21 11:02:20.047743 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User-Domain-Name: Default Jul 21 11:02:20.047743 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User-Id: a0aebc4614c448bdb77fb167d4ae3de1 Jul 21 11:02:20.047743 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: X-User-Name: tempest-TestVolumeBootPattern-786894644-project Jul 21 11:02:20.047743 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: method: > Jul 21 11:02:20.047743 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: exception: Instance 6ef47e35-a90e-4c42-9bbc-1e09a85d7d0e could not be found. Jul 21 11:02:20.047743 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: action_args: {'id': '6ef47e35-a90e-4c42-9bbc-1e09a85d7d0e'} Jul 21 11:02:20.048684 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: {{(pid=124867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 11:02:20.048684 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 11:02:20.048684 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 11:02:20.048684 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 11:02:20.048684 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 11:02:20.048684 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 11:02:20.048684 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 11:02:20.048684 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 11:02:20.048684 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 11:02:20.048684 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 11:02:20.048684 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ef47e35-a90e-4c42-9bbc-1e09a85d7d0e could not be found. Jul 21 11:02:20.048684 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 11:02:20.048684 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 11:02:20.048684 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 11:02:20.048684 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 11:02:20.048684 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 11:02:20.048684 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 11:02:20.048684 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 11:02:20.048684 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 11:02:20.048684 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 11:02:20.050215 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 11:02:20.050215 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 11:02:20.050215 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 11:02:20.050215 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 11:02:20.050215 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 11:02:20.050215 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 11:02:20.050215 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 11:02:20.050215 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ef47e35-a90e-4c42-9bbc-1e09a85d7d0e could not be found. Jul 21 11:02:20.050215 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 11:02:20.050215 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 11:02:20.050215 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 11:02:20.050215 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 11:02:20.050215 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 11:02:20.050215 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 11:02:20.050215 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 11:02:20.050215 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 11:02:20.050215 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ef47e35-a90e-4c42-9bbc-1e09a85d7d0e could not be found. Jul 21 11:02:20.050215 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: ERROR nova.api.openstack.wsgi Jul 21 11:02:20.051587 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: DEBUG nova.api.openstack.wsgi [None req-989d13df-7e48-493b-8563-9051300c4866 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Returning 404 to user: Instance 6ef47e35-a90e-4c42-9bbc-1e09a85d7d0e could not be found. {{(pid=124867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 11:02:20.051587 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO nova.api.openstack.requestlog [None req-989d13df-7e48-493b-8563-9051300c4866 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] 10.222.0.48 "GET /compute/v2.1/servers/6ef47e35-a90e-4c42-9bbc-1e09a85d7d0e" status: 404 len: 111 microversion: 2.1 time: 0.029366 Jul 21 11:02:20.051587 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: [pid: 124867|app: 0|req: 615/1221] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jul 21 11:02:20 2022] GET /compute/v2.1/servers/6ef47e35-a90e-4c42-9bbc-1e09a85d7d0e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 11:02:21.564448 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: DEBUG nova.api.openstack.wsgi [None req-dc0ac8f2-0ab5-40e7-992b-3b1809da8600 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] Calling method '.version_select at 0x7f796291f550>' {{(pid=124868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 11:02:21.646856 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO nova.api.openstack.requestlog [None req-dc0ac8f2-0ab5-40e7-992b-3b1809da8600 tempest-TestVolumeBootPattern-786894644 tempest-TestVolumeBootPattern-786894644-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-122371990" status: 202 len: 0 microversion: 2.1 time: 0.086097 Jul 21 11:02:21.647433 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: [pid: 124868|app: 0|req: 607/1222] 10.222.0.48 () {58 vars in 1259 bytes} [Thu Jul 21 11:02:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-122371990 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 11:03:10.114518 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 11:03:10.115215 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Thu Jul 21 11:03:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 11:03:12.538927 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 11:03:12.538927 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Thu Jul 21 11:03:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 11:04:45.644755 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 11:04:45.645413 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Thu Jul 21 11:04:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 11:05:04.726924 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 11:05:04.727507 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Thu Jul 21 11:05:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 11:05:07.554919 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 11:05:07.555494 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Thu Jul 21 11:05:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 11:05:08.216810 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 11:05:08.218848 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Thu Jul 21 11:05:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 11:06:30.123611 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 11:06:30.124200 dv-cinder-849800-2-iscsi devstack@n-api.service[124867]: Thu Jul 21 11:06:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 11:06:32.544406 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 11:06:32.544936 dv-cinder-849800-2-iscsi devstack@n-api.service[124868]: Thu Jul 21 11:06:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!